-- Logs begin at Sun 2022-10-23 19:27:30 UTC, end at Sun 2022-10-23 20:30:58 UTC. -- Oct 23 19:56:47.690233 dv-cinder-862432-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 19:56:47.699098 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 19:56:47 2022] *** Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: nodename: dv-cinder-862432-1-iscsi Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: machine: x86_64 Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: clock source: unix Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: pcre jit disabled Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: detected number of CPU cores: 4 Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: current working directory: / Oct 23 19:56:47.701639 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: detected binary path: /usr/bin/uwsgi-core Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: your processes number limit is 47680 Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: your memory page size is 4096 bytes Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: detected max file descriptor number: 2048 Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: lock engine: pthread robust mutexes Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: thunder lock: enabled Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 19:56:47.702347 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 19:56:47.740043 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: Python main interpreter initialized at 0x558074e949c0 Oct 23 19:56:47.740043 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: python threads support enabled Oct 23 19:56:47.740043 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: your server socket listen backlog is limited to 100 connections Oct 23 19:56:47.740043 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: your mercy for graceful operations on workers is 90 seconds Oct 23 19:56:47.740427 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 19:56:47.740503 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: *** Operational MODE: preforking *** Oct 23 19:56:47.740718 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: *** uWSGI is running in multiple interpreter mode *** Oct 23 19:56:47.740718 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: spawned uWSGI master process (pid: 103874) Oct 23 19:56:47.740891 dv-cinder-862432-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 23 19:56:47.741419 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: spawned uWSGI worker 1 (pid: 103875, cores: 1) Oct 23 19:56:47.742277 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: spawned uWSGI worker 2 (pid: 103876, cores: 1) Oct 23 19:56:47.742277 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 19:56:48.392572 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 19:56:48.393805 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 19:56:49.456172 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:56:49.456172 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: from cryptography.utils import int_from_bytes Oct 23 19:56:49.456787 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:56:49.456787 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: from cryptography.utils import int_from_bytes Oct 23 19:56:49.460199 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:56:49.460199 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: from cryptography.utils import int_from_bytes Oct 23 19:56:49.460638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:56:49.460638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: from cryptography.utils import int_from_bytes Oct 23 19:56:51.922883 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 19:56:51.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 19:56:51.923649 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 19:56:51.924005 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 19:56:51.924250 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 19:56:51.924625 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.924739 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 19:56:51.925102 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.925185 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 19:56:51.925263 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.925520 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 19:56:51.925616 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.925846 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.925939 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 19:56:51.926117 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 19:56:51.926210 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.926468 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.926568 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.926779 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.926878 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927099 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927194 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927367 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927465 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927660 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927754 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.927973 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-1-iscsi {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928058 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928286 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928385 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928585 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928678 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928887 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.928973 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929187 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929280 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929482 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929566 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929795 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.929888 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-1-iscsi {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.930092 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.930184 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.930431 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.930611 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.930737 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.931740 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.931873 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.931980 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932101 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932182 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932474 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932474 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932681 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932773 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932863 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.932948 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933026 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933158 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933286 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933401 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933617 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933706 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.933927 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934088 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-1-iscsi {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934311 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934439 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934584 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934743 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.934889 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935046 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935206 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935454 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935594 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935763 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.935887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-1-iscsi {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936065 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936197 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936378 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936503 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936703 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.936809 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937005 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937214 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937324 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937525 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937651 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937832 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.937928 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938165 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938290 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938490 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938583 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938795 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.938886 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939114 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939213 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939424 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939515 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939723 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.939814 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940022 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940114 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940276 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940562 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940652 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940874 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.940965 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941186 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941276 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941493 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941582 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941736 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941824 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.941968 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.942343 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.942562 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.942669 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.942877 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.942970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943181 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943280 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943481 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943573 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943742 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.943834 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944038 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944130 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944303 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944393 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944610 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944706 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.944913 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945017 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945208 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945299 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945508 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945813 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.945995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946141 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946230 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946437 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946531 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946746 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.946850 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947050 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947149 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947359 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947458 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947659 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947767 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.947974 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948066 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948277 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948368 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948578 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948682 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948888 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.948987 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.949200 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.949298 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.949499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.949591 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.950381 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.950475 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.950688 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.950798 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951000 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951100 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951324 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951424 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951624 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951723 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951875 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.951963 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952156 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952248 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952452 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952543 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952761 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.952860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953056 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953205 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953343 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953492 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953630 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953764 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.953910 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954045 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954202 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954379 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954527 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954687 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.954896 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955039 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955182 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955336 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955486 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955623 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955770 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.955907 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956061 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956275 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956419 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956557 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956693 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.956919 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957072 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957234 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957385 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957523 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957660 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957809 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.957956 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958094 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958237 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958460 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958601 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958737 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.958887 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959033 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959177 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959314 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959450 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959587 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959750 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.959888 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960032 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960170 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960321 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960466 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960617 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960757 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.960893 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961029 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961165 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961302 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961450 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961606 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961757 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.961895 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962032 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962182 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962355 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962495 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962632 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962769 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.962905 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963041 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963185 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963323 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963469 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963605 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963743 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.963887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964038 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964176 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964311 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964447 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964620 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964770 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.964926 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.965133 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.965294 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.965444 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966145 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966323 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966477 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966629 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966779 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.966935 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967171 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967334 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967473 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967609 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967745 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.967893 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.968031 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.968176 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.968313 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.968450 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.968603 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.968741 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.968885 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.969023 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.969159 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.969297 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.969446 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.969590 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:56:51.969749 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.969887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970023 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970159 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970333 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970488 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970635 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970773 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.970952 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971091 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971235 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971381 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971529 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971665 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971801 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.971936 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972072 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972408 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972554 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972691 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972834 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.972997 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973144 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973295 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973434 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973585 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973722 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973859 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.973995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974140 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974299 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974452 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974590 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974726 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.974861 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975006 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975168 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975380 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975533 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975671 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.975953 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976091 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976228 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976371 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976508 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976660 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976798 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.976940 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.977260 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.977428 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.977577 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.977729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.977875 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978021 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978021 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978314 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978461 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978608 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978746 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.978883 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979018 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979154 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979310 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979457 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979596 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979733 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.979889 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980028 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980176 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980451 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980587 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980724 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.980860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981006 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981169 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981314 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981452 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981596 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981733 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.981878 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982015 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982151 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982311 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982455 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982591 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982740 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.982877 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983023 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983160 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983296 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983296 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983569 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983708 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983844 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.983979 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984115 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984259 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984396 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984533 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984686 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984825 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.984961 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985105 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985244 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985398 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985606 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985749 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.985887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986036 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986183 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986345 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986641 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986778 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.986929 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987066 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987209 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987435 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987580 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987725 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.987870 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988016 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988155 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988298 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988436 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988590 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988740 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.988886 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989100 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989241 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989378 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989523 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989668 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989812 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.989962 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990107 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990303 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990463 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990614 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990751 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.990886 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991031 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991177 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991451 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991588 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991731 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.991868 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992013 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992160 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992308 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992457 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992594 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992731 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.992876 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993012 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993156 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993300 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993445 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993581 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993726 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.993865 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994001 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994149 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994307 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994529 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994670 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994813 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.994951 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995087 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995223 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995367 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995506 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995725 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.995870 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996014 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996175 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996327 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996466 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996603 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996739 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.996882 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997019 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997164 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997314 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997467 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997673 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997823 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.997971 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998124 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998317 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998474 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998612 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998756 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.998907 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999046 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999182 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999318 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999454 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999601 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999751 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:51.999899 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000037 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000172 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000308 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000445 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000594 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000732 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.000868 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001004 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001140 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001285 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001431 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001578 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001726 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.001863 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002006 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002154 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002313 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002455 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002603 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002740 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.002875 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003020 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003158 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003294 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003437 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003584 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003721 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.003873 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004010 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004146 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004282 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004425 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004569 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004740 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.004886 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005050 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005194 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005364 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005526 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005664 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.005886 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006029 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006166 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006350 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006507 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006646 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006791 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.006929 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.007074 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.007226 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.007376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.007524 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008135 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008287 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008426 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008571 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008717 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008857 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.008993 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009129 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009264 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009408 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009557 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009706 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009843 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.009979 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010115 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010278 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010424 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010560 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010696 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010832 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.010968 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011114 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011252 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011388 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011534 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011670 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011805 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.011950 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.012088 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.012224 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013007 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013166 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013321 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013466 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013609 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013752 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.013895 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014049 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014202 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014395 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014551 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014696 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014839 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.014989 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.015147 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.015292 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.015435 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.015577 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.015720 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.016334 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.016526 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.016686 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.016831 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.016974 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017117 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017269 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017414 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017557 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017699 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.017860 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018004 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018181 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018419 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018593 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018746 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.018899 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019043 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019212 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019359 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019502 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019644 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019788 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.019930 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020081 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020226 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020535 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020681 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020824 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.020975 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021119 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021262 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021404 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021556 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021709 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021852 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.021995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022146 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022334 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022509 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022664 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022809 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.022952 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023101 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023244 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023387 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023617 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023781 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.023926 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024070 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024212 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024374 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024532 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024685 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024829 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.024972 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025115 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025271 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025416 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025416 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025687 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025840 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.025983 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026135 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026308 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026539 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026691 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026835 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.026976 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027132 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027278 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027428 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027572 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027716 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.027878 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.028598 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.028820 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.028820 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029110 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029254 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029407 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029552 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029696 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029840 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.029982 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030133 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030322 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030496 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030496 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030804 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.030951 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031094 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031237 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031389 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031534 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031677 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031677 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.031947 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032098 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032251 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032403 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032555 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032709 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032852 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.032995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.033277 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.033430 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.033584 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.033729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.033872 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034016 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034171 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034349 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034506 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034660 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034810 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.034955 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035107 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035251 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035402 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035545 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035688 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035843 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.035988 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036132 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036275 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036417 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036658 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.036964 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037108 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037251 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037406 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037551 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037704 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.037860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038005 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038147 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038323 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038494 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038649 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.038812 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039027 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039178 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039323 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039484 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039630 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039774 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.039918 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040068 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040213 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040366 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040520 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040665 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040808 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.040951 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041095 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041246 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041401 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041546 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041690 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041840 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.041984 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042136 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042316 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042479 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042624 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042766 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.042919 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043062 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043205 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043366 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043512 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043687 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.043841 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044028 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044179 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044342 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044488 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044639 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044793 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.044944 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045089 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045240 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045393 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045539 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045692 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045837 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.045980 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.046132 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.046340 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.046504 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.046685 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.046901 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047058 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047203 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047347 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047574 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.047878 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048022 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048022 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048293 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048456 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048601 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048746 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.048888 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049050 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049263 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049427 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049582 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.049879 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050032 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050184 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050355 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050522 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050667 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050811 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.050961 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051114 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051266 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051410 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051703 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.051848 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052000 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052144 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052287 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052440 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052583 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052734 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.052892 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053037 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053180 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053322 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053465 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053617 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053768 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.053913 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054056 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054209 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054405 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054568 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054714 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.054858 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055001 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055144 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055287 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055444 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055590 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055741 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.055887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056031 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056193 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056352 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056505 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056649 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.056792 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057025 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057188 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057333 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057477 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057619 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057772 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.057916 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058068 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058225 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058394 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058539 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058697 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.058849 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059006 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059176 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059407 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059558 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059701 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059843 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.059995 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060140 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060294 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060437 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060579 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060730 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.060875 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061017 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061159 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061303 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061446 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061597 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061741 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.061884 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062033 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062187 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062373 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062530 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062676 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062819 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.062961 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063110 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063254 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063407 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063551 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063694 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.063837 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064006 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064120 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064219 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064304 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064385 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064465 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064543 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064631 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064731 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064810 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064887 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.064964 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065041 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065128 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065209 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065295 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065374 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065453 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065530 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065617 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065697 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065783 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065870 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.065950 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066028 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066114 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066201 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066338 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066426 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066506 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066598 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066680 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066758 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066835 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066913 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.066990 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067324 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067406 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067473 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067538 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067602 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067665 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067738 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067805 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.067992 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068095 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068299 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068387 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068603 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068696 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068901 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.068989 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069207 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069304 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069512 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069611 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069810 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.069897 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070111 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070207 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070432 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070519 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070738 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.070826 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071040 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071136 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071416 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071502 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071719 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.071808 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072015 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072110 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072311 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072396 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072612 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072700 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.072919 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073006 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073212 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073297 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073507 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073593 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073805 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.073915 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.074119 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.074308 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.074463 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.074609 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.075274 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.075433 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.075629 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.075781 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.075925 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076069 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076222 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076367 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076511 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076654 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076798 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.076951 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077115 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077332 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077491 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077636 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077779 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.077933 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078079 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078222 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078396 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078540 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078683 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.078838 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079003 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079162 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079308 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079462 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079606 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079750 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.079892 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080044 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080191 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080334 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080477 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080619 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080762 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.080918 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081064 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081239 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081401 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081545 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081738 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.081898 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082045 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082189 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082387 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082532 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082693 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082839 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.082983 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083126 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083281 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083425 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083641 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083789 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.083943 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084087 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084231 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084375 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084529 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084675 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.084961 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085113 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085278 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085424 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085566 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085710 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085852 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.085995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086147 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086309 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086459 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086601 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086744 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.086887 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087043 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087205 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087367 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087591 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087741 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.087885 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088038 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088182 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088182 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088453 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088597 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088750 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.088895 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089044 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089199 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089342 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089485 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089638 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089638 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.089911 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090053 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090196 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090363 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090578 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.090873 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091028 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091179 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091325 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091477 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091630 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091815 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.091815 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092101 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092101 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092391 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092391 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092662 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092806 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.092961 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093117 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093272 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093417 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093560 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093702 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.093846 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094009 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094154 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094438 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094531 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094611 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094801 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.094892 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095098 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095186 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095396 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095494 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095694 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095784 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.095996 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096085 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096298 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096401 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096594 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096682 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096890 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.096977 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097300 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097501 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097588 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097814 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.097903 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098116 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098204 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098438 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098526 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098736 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.098823 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099035 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099124 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099334 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099420 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099642 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099742 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.099945 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100044 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100241 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100328 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100542 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100628 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100851 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.100938 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101155 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101241 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101462 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101556 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101767 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.101852 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102068 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102155 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102393 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102496 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102696 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102792 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.102995 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103081 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103307 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103402 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103615 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103702 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.103926 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.104012 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.104249 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.104436 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.104899 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.104985 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105064 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105177 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105335 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105494 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105641 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105809 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.105950 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.106665 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.106809 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.106983 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107117 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107295 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107421 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107603 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107724 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.107917 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108028 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108231 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108350 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108545 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108757 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.108965 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109100 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109290 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109429 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109599 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109740 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.109905 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110057 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110212 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110369 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110541 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110682 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110889 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.110978 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111194 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111294 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111492 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111580 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111796 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.111883 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112103 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112273 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112410 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112498 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112712 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.112799 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113015 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113111 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113320 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113406 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113622 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113716 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.113923 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114022 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114224 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114392 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114571 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114671 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114849 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.114938 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115163 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115258 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115488 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115584 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115799 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.115899 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116103 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116190 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116406 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116506 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116714 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.116800 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117020 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117218 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117524 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117613 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117848 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.117935 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118164 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118310 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118502 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118592 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118814 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.118901 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119121 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119215 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119438 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119524 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119736 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.119823 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120034 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120169 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120336 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120433 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120636 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120723 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.120935 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.121146 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.121242 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.121465 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.121551 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.122393 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.122497 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.122719 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.122809 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123041 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123138 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123357 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123560 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123673 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123902 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.123993 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124215 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124302 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124533 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124637 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124853 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.124960 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125160 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125262 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125461 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125550 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125776 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.125863 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126075 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126178 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126397 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126486 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126711 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.126797 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127015 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127113 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127315 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127544 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127632 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.127893 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128020 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128196 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128282 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128493 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128581 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128797 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.128884 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129096 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129190 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129413 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129509 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129714 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.129810 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130012 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130099 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130331 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130421 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130636 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130735 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.130933 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131020 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131229 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131315 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131528 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131624 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131825 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.131911 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132129 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132214 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132424 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132518 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132725 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.132813 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133022 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133109 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133323 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133411 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133630 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133727 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.133934 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134021 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134237 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134371 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134563 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134651 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134865 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.134984 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135167 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135257 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135467 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135564 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135766 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.135866 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136074 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136165 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136468 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136682 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136789 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.136983 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137075 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137309 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137406 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137664 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137858 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.137958 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138210 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138322 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138528 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138620 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138857 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.138957 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139166 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139258 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139468 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139566 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139768 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.139860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140066 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140158 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140380 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140481 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140680 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140771 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.140985 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141077 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141286 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141452 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141588 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141842 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.141935 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142174 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142288 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142503 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142591 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142803 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.142895 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143103 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143270 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143433 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143521 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143690 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143841 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.143989 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144125 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144309 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144459 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144608 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144755 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.144865 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145063 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145224 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145372 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145527 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145675 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145826 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.145921 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146098 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146274 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146431 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146579 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146740 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.146888 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147046 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147196 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147347 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147494 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147655 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147748 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.147934 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148091 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148265 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148360 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148580 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148670 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148847 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.148935 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.149264 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.149494 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.149587 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.149802 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.149894 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150117 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150209 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150458 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150551 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150761 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.150860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151078 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151172 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151394 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151487 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151698 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.151790 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152010 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152114 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152312 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152404 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152634 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.152734 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.153446 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.153553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.153804 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154122 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154213 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154448 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154541 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154747 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.154840 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155044 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155144 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155345 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155446 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155658 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155752 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.155962 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156054 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156259 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156360 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156555 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156646 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156861 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.156954 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157157 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157258 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157455 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157548 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157752 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.157844 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158049 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158150 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158366 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158458 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158664 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158756 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.158960 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159064 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159252 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159343 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159542 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159634 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159835 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.159934 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160130 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160229 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160431 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160523 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160725 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.160818 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161020 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161112 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161316 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161413 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161611 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161704 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161904 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.161995 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162227 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162379 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162556 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162745 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162884 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.162986 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163174 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163271 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163441 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163528 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163732 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.163824 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164033 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164139 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164340 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164432 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164640 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164832 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.164922 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165000 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165221 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165366 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165509 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165651 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165806 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.165951 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166109 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166282 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166434 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166578 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166733 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.166889 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167033 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167177 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167328 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167509 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167662 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167806 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.167950 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.168092 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.168243 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.168396 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.168566 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169225 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169391 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169536 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169680 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169836 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.169982 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170125 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170293 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170445 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170589 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170808 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.170991 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171142 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171298 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171444 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171594 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171751 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.171896 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172039 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172194 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172339 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172492 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.172825 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173011 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173175 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173321 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173475 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173620 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173764 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.173935 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174081 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174224 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174427 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174574 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174717 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.174860 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175017 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175181 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175328 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175616 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175758 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.175902 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176053 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176199 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176342 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176487 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176630 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176774 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.176939 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177086 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177229 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177373 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177524 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177678 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 19:56:52.177823 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.177823 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.178148 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.178483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.178809 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.179134 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.179481 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.179794 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.180135 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.180462 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.180775 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.181085 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.181393 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:56:52.181713 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 19:56:52.329573 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO dbcounter [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Registered counter for database nova_api Oct 23 19:56:52.334447 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO dbcounter [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Registered counter for database nova_api Oct 23 19:56:52.351362 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_db.sqlalchemy.engines [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.354539 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_db.sqlalchemy.engines [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.358589 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writer thread running {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.361581 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writer thread running {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.413956 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.context [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ff9404b-133d-4e93-bd33-12d6dd4a8031(cell1) {{(pid=103875) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 19:56:52.417034 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.context [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ff9404b-133d-4e93-bd33-12d6dd4a8031(cell1) {{(pid=103876) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 19:56:52.417798 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 19:56:52.418295 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 19:56:52.420451 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 19:56:52.421153 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 19:56:52.421412 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 19:56:52.421589 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 19:56:52.421885 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 19:56:52.423559 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 19:56:52.423659 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 19:56:52.424218 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 19:56:52.424661 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 19:56:52.425549 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO dbcounter [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Registered counter for database nova_cell0 Oct 23 19:56:52.426676 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_concurrency.lockutils [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 19:56:52.428735 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO dbcounter [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Registered counter for database nova_cell0 Oct 23 19:56:52.429578 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO dbcounter [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Registered counter for database nova_cell1 Oct 23 19:56:52.432856 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO dbcounter [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Registered counter for database nova_cell1 Oct 23 19:56:52.436692 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_db.sqlalchemy.engines [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.438754 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_db.sqlalchemy.engines [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.440309 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_db.sqlalchemy.engines [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.443961 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writer thread running {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.444213 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_db.sqlalchemy.engines [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.446225 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writer thread running {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.446673 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writer thread running {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.585400 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writer thread running {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.589108 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO dbcounter [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Registered counter for database nova_cell0 Oct 23 19:56:52.595211 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO dbcounter [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Registered counter for database nova_cell0 Oct 23 19:56:52.596705 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_db.sqlalchemy.engines [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.601381 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writer thread running {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.601909 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG oslo_db.sqlalchemy.engines [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:56:52.606499 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writer thread running {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:56:52.933917 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: WARNING keystonemiddleware.auth_token [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 19:56:52.938477 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: WARNING keystonemiddleware.auth_token [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 19:56:52.941185 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: WARNING keystonemiddleware.auth_token [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 19:56:52.945968 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: WARNING keystonemiddleware.auth_token [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 19:56:53.279076 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: WARNING keystonemiddleware.auth_token [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 19:56:53.284922 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: WARNING keystonemiddleware.auth_token [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 19:56:53.285039 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: WARNING keystonemiddleware.auth_token [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 19:56:53.290201 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558074e949c0 pid: 103875 (default app) Oct 23 19:56:53.290951 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: WARNING keystonemiddleware.auth_token [None req-47bbdc4c-2ead-4ca1-bed8-8f5d63267e01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 19:56:53.292235 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:56:53.293413 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001686 Oct 23 19:56:53.294363 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sun Oct 23 19:56:53 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:56:53.296736 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558074e949c0 pid: 103876 (default app) Oct 23 19:58:13.665551 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:13.667428 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Oct 23 19:58:13.673202 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:13.680320 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_api:SELECT=3 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:13.681420 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_cell0:SELECT=3 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:13.682708 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_cell1:SELECT=3 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:13.684757 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:14.553563 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-14ffe90a-2a4c-4e5c-8972-c8c490a270a5 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:14.586370 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-14ffe90a-2a4c-4e5c-8972-c8c490a270a5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911150 Oct 23 19:58:14.587105 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 19:58:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 19:58:17.179782 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:17.180847 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-2ecde71d-b27b-40e0-aa68-7cb75238180a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 23 19:58:17.181377 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:17.634808 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-c7c3d57b-04a0-4323-a012-e6022597649c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "name": "cirros256"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:17.682089 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-c7c3d57b-04a0-4323-a012-e6022597649c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494235 Oct 23 19:58:17.682694 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:17.697042 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_api:SELECT=3 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:17.697882 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_cell1:SELECT=3 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:17.699899 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_cell0:SELECT=3 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:17.700647 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:17.904657 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e656718a-92de-4ec8-8443-e742992c1184 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:17.971500 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-e656718a-92de-4ec8-8443-e742992c1184 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279810 Oct 23 19:58:17.972153 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 19:58:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:20.574546 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-c7c3d57b-04a0-4323-a012-e6022597649c admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:20.576149 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-c7c3d57b-04a0-4323-a012-e6022597649c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 Oct 23 19:58:20.576544 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:21.223469 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-85e81786-b85b-47e5-b67a-281a77e2ec5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:21.264377 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-85e81786-b85b-47e5-b67a-281a77e2ec5a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681636 Oct 23 19:58:21.265151 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:21.277345 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-89483bb6-8fe8-46fb-92f1-738631701200 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:21.316867 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-89483bb6-8fe8-46fb-92f1-738631701200 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043226 Oct 23 19:58:21.317441 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 19:58:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:23.905108 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-85e81786-b85b-47e5-b67a-281a77e2ec5a admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:23.906128 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-85e81786-b85b-47e5-b67a-281a77e2ec5a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 23 19:58:23.906575 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:24.336105 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-2fa05b0f-af11-41fa-bd4a-d1e8d5c7bf5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:24.355699 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-2fa05b0f-af11-41fa-bd4a-d1e8d5c7bf5f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441759 Oct 23 19:58:24.356460 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:24.368281 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-1c8ea17d-c8f4-4db1-9557-3c7c43338030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:24.397501 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-1c8ea17d-c8f4-4db1-9557-3c7c43338030 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032892 Oct 23 19:58:24.398073 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 19:58:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:27.013494 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-2fa05b0f-af11-41fa-bd4a-d1e8d5c7bf5f admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:27.015108 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-2fa05b0f-af11-41fa-bd4a-d1e8d5c7bf5f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Oct 23 19:58:27.022907 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:27.428628 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-d9cdeadc-0b3d-4fa9-852c-1654ae7fc12e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "ram": 2048}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:27.447721 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-d9cdeadc-0b3d-4fa9-852c-1654ae7fc12e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425900 Oct 23 19:58:27.448493 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 19:58:27.461610 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-0dbf156e-0f4e-4859-95ab-63206e35ccda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:27.491859 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-0dbf156e-0f4e-4859-95ab-63206e35ccda admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034497 Oct 23 19:58:27.492435 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 19:58:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 19:58:30.130400 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-d9cdeadc-0b3d-4fa9-852c-1654ae7fc12e admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:30.132188 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-d9cdeadc-0b3d-4fa9-852c-1654ae7fc12e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002418 Oct 23 19:58:30.132815 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:30.615280 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "id": "d4", "name": "ds4G", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:30.634945 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495134 Oct 23 19:58:30.635506 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 19:58:30.650677 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-82210f13-449b-4de1-87de-d4305dd18c72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:30.682727 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-82210f13-449b-4de1-87de-d4305dd18c72 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037431 Oct 23 19:58:30.684339 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 23 19:58:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:33.701859 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:33.702906 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 23 19:58:33.703305 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:34.168830 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e87da568-e4b9-4022-907f-3361686b0f6f admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:34.194423 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-e87da568-e4b9-4022-907f-3361686b0f6f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.484445 Oct 23 19:58:34.194967 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 19:58:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:58:36.785877 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:36.787208 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-c527947e-dc77-4fd9-901c-74d58fe4d37a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Oct 23 19:58:36.787713 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:37.188173 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-fdf44059-baa9-4d71-a8b1-2ab8e0443406 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:37.207965 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-fdf44059-baa9-4d71-a8b1-2ab8e0443406 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.413841 Oct 23 19:58:37.208607 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:37.220989 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-6d3606b2-166f-4121-a02b-cd019b0b3c90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:37.248586 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-6d3606b2-166f-4121-a02b-cd019b0b3c90 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031217 Oct 23 19:58:37.249342 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 19:58:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:39.857415 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-fdf44059-baa9-4d71-a8b1-2ab8e0443406 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:39.858586 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-fdf44059-baa9-4d71-a8b1-2ab8e0443406 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 23 19:58:39.858992 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:40.236580 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-1fa4adf8-ba8f-4444-ab67-a0fd95690b22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:40.257531 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-1fa4adf8-ba8f-4444-ab67-a0fd95690b22 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.392423 Oct 23 19:58:40.258080 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:40.271875 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f339b20f-ce7b-43b0-b01b-a89f9c20ac5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:40.302542 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f339b20f-ce7b-43b0-b01b-a89f9c20ac5c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035884 Oct 23 19:58:40.314754 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 19:58:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 19:58:42.916176 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-1fa4adf8-ba8f-4444-ab67-a0fd95690b22 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:42.917710 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-1fa4adf8-ba8f-4444-ab67-a0fd95690b22 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 23 19:58:42.918357 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:43.355850 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-ffa58f39-558b-409c-8eed-d83bdacd30c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "disk": 40, "id": "3", "vcpus": 2}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:43.378284 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-ffa58f39-558b-409c-8eed-d83bdacd30c8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.453791 Oct 23 19:58:43.382401 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:43.391759 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-a463c740-80c3-4e91-baaf-db8d8d0f587e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:43.420731 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-a463c740-80c3-4e91-baaf-db8d8d0f587e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032734 Oct 23 19:58:43.421914 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 19:58:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 19:58:46.140849 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-ffa58f39-558b-409c-8eed-d83bdacd30c8 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:46.142519 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-ffa58f39-558b-409c-8eed-d83bdacd30c8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Oct 23 19:58:46.142926 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:46.595075 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-9962b7b5-9cad-4e8b-b4e8-b1bd7a72c794 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:46.603919 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:46.618521 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-9962b7b5-9cad-4e8b-b4e8-b1bd7a72c794 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469304 Oct 23 19:58:46.619773 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:58:46.636341 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f340c726-b8fe-4f27-98c6-b512f590535e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:46.686836 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f340c726-b8fe-4f27-98c6-b512f590535e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057478 Oct 23 19:58:46.694956 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 19:58:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:58:49.310645 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-9962b7b5-9cad-4e8b-b4e8-b1bd7a72c794 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:58:49.312527 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-9962b7b5-9cad-4e8b-b4e8-b1bd7a72c794 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002368 Oct 23 19:58:49.313300 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:58:49.760262 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "id": "5", "ram": 16384}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:49.768365 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:49.783491 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463568 Oct 23 19:58:49.784050 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 23 19:58:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 19:58:49.798010 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-e819b146-5e69-4450-995d-55ccb08b2291 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:58:49.826937 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-e819b146-5e69-4450-995d-55ccb08b2291 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033790 Oct 23 19:58:49.827653 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 23 19:58:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 19:59:06.216857 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:06.217916 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 23 19:59:06.218364 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 19:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:06.228836 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:06.612346 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-b9e2837e-5cc4-436e-a4af-f01480079446 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:06.630062 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-b9e2837e-5cc4-436e-a4af-f01480079446 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405682 Oct 23 19:59:06.630565 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 19:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:59:07.912919 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:07.913920 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f750829f-be44-4184-b5e7-192376d404fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 23 19:59:07.914341 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:08.429627 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fc113dc2-ed27-4066-b0d0-a0f73ae36b1d admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:08.435500 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.wsgi [None req-fc113dc2-ed27-4066-b0d0-a0f73ae36b1d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fc113dc2-ed27-4066-b0d0-a0f73ae36b1d admin admin] Request method failure captured: Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept: application/json Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept-Encoding: gzip, deflate Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Connection: keep-alive Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Content-Length: 0 Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Host: 10.222.0.13 Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-System-Scope: None Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: User-Agent: python-novaclient Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Auth-Token: gAAAAABjVZ0LezC4-f7w_5VSrpk4NH2VWBP-5irU7dfkV0zhoATD6ku7lJl0SNAsYx8VAKoCAr1ujnfpBk8xnpByS55C5MzJ3egHoa3RRdOkt783pg0mQ8nbvmMWOjnKjRwHgaU0kHJL50GDb5Ppm1-QLyzadZrFHmvd8gIzARS_n-23s5ECWtQ Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Id: None Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Name: None Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Identity-Status: Confirmed Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Is-Admin-Project: True Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Id: default Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Name: Default Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Name: admin Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Role: member,admin,reader Oct 23 19:59:08.438745 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Roles: member,admin,reader Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant: admin Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Name: admin Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User: admin Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Id: default Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Name: Default Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Name: admin Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: method: > Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: exception: Flavor 42 could not be found. Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: action_args: {'id': '42'} Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:08.440365 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:08.441376 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.442854 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fc113dc2-ed27-4066-b0d0-a0f73ae36b1d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:08.444115 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fc113dc2-ed27-4066-b0d0-a0f73ae36b1d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389058 Oct 23 19:59:08.444115 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 19:59:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:08.450380 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-f0eeb2df-2fdf-462d-a903-4c945337ef34 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:08.472412 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-f0eeb2df-2fdf-462d-a903-4c945337ef34 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025941 Oct 23 19:59:08.472949 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:59:08.483911 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-27bb1226-adf1-4afe-b9d3-026d03991d84 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:08.505894 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-27bb1226-adf1-4afe-b9d3-026d03991d84 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026961 Oct 23 19:59:08.506437 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:59:08.515427 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e1993df6-f978-4d8d-9561-7d5d148c99b2 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:08.520593 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.wsgi [None req-e1993df6-f978-4d8d-9561-7d5d148c99b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e1993df6-f978-4d8d-9561-7d5d148c99b2 admin admin] Request method failure captured: Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept: application/json Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept-Encoding: gzip, deflate Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Connection: keep-alive Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Content-Length: 0 Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Host: 10.222.0.13 Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-System-Scope: None Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: User-Agent: python-novaclient Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Auth-Token: gAAAAABjVZ0LezC4-f7w_5VSrpk4NH2VWBP-5irU7dfkV0zhoATD6ku7lJl0SNAsYx8VAKoCAr1ujnfpBk8xnpByS55C5MzJ3egHoa3RRdOkt783pg0mQ8nbvmMWOjnKjRwHgaU0kHJL50GDb5Ppm1-QLyzadZrFHmvd8gIzARS_n-23s5ECWtQ Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Id: None Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Name: None Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Identity-Status: Confirmed Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Is-Admin-Project: True Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Id: default Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Name: Default Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Name: admin Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Role: member,admin,reader Oct 23 19:59:08.523811 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Roles: member,admin,reader Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant: admin Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Name: admin Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User: admin Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Id: default Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Name: Default Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Name: admin Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: method: > Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: exception: Flavor 42 could not be found. Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: action_args: {'id': '42'} Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:08.525234 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:08.526499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:08.527807 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e1993df6-f978-4d8d-9561-7d5d148c99b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:08.529096 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-e1993df6-f978-4d8d-9561-7d5d148c99b2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013297 Oct 23 19:59:08.529096 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 19:59:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 23 19:59:09.720167 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-27bb1226-adf1-4afe-b9d3-026d03991d84 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:09.721208 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-27bb1226-adf1-4afe-b9d3-026d03991d84 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 23 19:59:09.721613 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:10.242031 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-86199aea-a342-41de-b375-a72ab3216132 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:10.247473 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.wsgi [None req-86199aea-a342-41de-b375-a72ab3216132 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-86199aea-a342-41de-b375-a72ab3216132 admin admin] Request method failure captured: Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept: application/json Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept-Encoding: gzip, deflate Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Connection: keep-alive Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Content-Length: 0 Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Host: 10.222.0.13 Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-System-Scope: None Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: User-Agent: python-novaclient Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Auth-Token: gAAAAABjVZ0N9FiQp65wUpmy5XegPsaWLbexc07a5yl2SlzN8H7yg33hbQHNhuvGS5cabjKn8Bu7BQo2GwWVZW64WrRxnv0lJPTuprCUHvFR7StIM9uHXB8lc_MaC7sLIxpCeQS_O8zqU_TCC_xMVZ-RKoyKY5lSbH60blkc2_suWYLUCNpmASQ Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Id: None Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Name: None Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Identity-Status: Confirmed Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Is-Admin-Project: True Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Id: default Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Name: Default Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Name: admin Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Role: member,admin,reader Oct 23 19:59:10.248964 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Roles: member,admin,reader Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant: admin Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Name: admin Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User: admin Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Id: default Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Name: Default Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Name: admin Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: method: > Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: exception: Flavor 84 could not be found. Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: action_args: {'id': '84'} Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:10.250411 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:10.251204 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.252553 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-86199aea-a342-41de-b375-a72ab3216132 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:10.253778 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-86199aea-a342-41de-b375-a72ab3216132 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390021 Oct 23 19:59:10.253778 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 19:59:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:10.259880 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-15accc96-c7f6-4835-a33f-71225663a359 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:10.275065 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-15accc96-c7f6-4835-a33f-71225663a359 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018736 Oct 23 19:59:10.275585 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:59:10.284647 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-7ad05080-5cb2-4d92-8e62-8228f3cf353c admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:10.299763 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-7ad05080-5cb2-4d92-8e62-8228f3cf353c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018577 Oct 23 19:59:10.300318 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 19:59:10.309690 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-b66069fd-00da-46cc-91ba-afdd2776fe1c admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:10.314500 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.wsgi [None req-b66069fd-00da-46cc-91ba-afdd2776fe1c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-b66069fd-00da-46cc-91ba-afdd2776fe1c admin admin] Request method failure captured: Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept: application/json Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept-Encoding: gzip, deflate Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Connection: keep-alive Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Content-Length: 0 Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Host: 10.222.0.13 Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-System-Scope: None Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: User-Agent: python-novaclient Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Auth-Token: gAAAAABjVZ0N9FiQp65wUpmy5XegPsaWLbexc07a5yl2SlzN8H7yg33hbQHNhuvGS5cabjKn8Bu7BQo2GwWVZW64WrRxnv0lJPTuprCUHvFR7StIM9uHXB8lc_MaC7sLIxpCeQS_O8zqU_TCC_xMVZ-RKoyKY5lSbH60blkc2_suWYLUCNpmASQ Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Id: None Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Name: None Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Identity-Status: Confirmed Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Is-Admin-Project: True Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Id: default Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Name: Default Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Name: admin Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Role: member,admin,reader Oct 23 19:59:10.315994 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Roles: member,admin,reader Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant: admin Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Name: admin Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User: admin Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Id: default Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Name: Default Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Name: admin Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: method: > Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: exception: Flavor 84 could not be found. Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: action_args: {'id': '84'} Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:10.317483 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:10.318471 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:10.319970 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-b66069fd-00da-46cc-91ba-afdd2776fe1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:10.321094 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-b66069fd-00da-46cc-91ba-afdd2776fe1c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011625 Oct 23 19:59:10.321094 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 23 19:59:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:11.510728 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-7ad05080-5cb2-4d92-8e62-8228f3cf353c admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:11.511729 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-7ad05080-5cb2-4d92-8e62-8228f3cf353c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 23 19:59:11.512129 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:12.032732 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-2cf29cf3-9371-4ebb-864c-f0b8c2d71e79 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:12.038658 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.wsgi [None req-2cf29cf3-9371-4ebb-864c-f0b8c2d71e79 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-2cf29cf3-9371-4ebb-864c-f0b8c2d71e79 admin admin] Request method failure captured: Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept: application/json Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Accept-Encoding: gzip, deflate Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Connection: keep-alive Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Content-Length: 0 Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Host: 10.222.0.13 Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Openstack-System-Scope: None Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: User-Agent: python-novaclient Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Auth-Token: gAAAAABjVZ0PlqHLAH7NJsqidG-9cstNRAp2J6BTdQYXBcOlYW0sid60m2xA-djVyHjbgbvj0K0ZD88ULbX7GloZPJ2phDOM4bN4lTpWkCvfAf66FHTvv3GQpScgXecvy229v89xSoOCnCYa7qAnsFX89VftfweESoPWrRLEy4gDnJHfnI-KG6s Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Id: None Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Domain-Name: None Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Identity-Status: Confirmed Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Is-Admin-Project: True Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Id: default Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Domain-Name: Default Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Project-Name: admin Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Role: member,admin,reader Oct 23 19:59:12.040162 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Roles: member,admin,reader Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant: admin Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-Tenant-Name: admin Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User: admin Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Id: default Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Domain-Name: Default Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: X-User-Name: admin Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: method: > Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: exception: Flavor 451 could not be found. Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: action_args: {'id': '451'} Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:12.041677 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:12.042638 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.043969 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-2cf29cf3-9371-4ebb-864c-f0b8c2d71e79 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:12.045186 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-2cf29cf3-9371-4ebb-864c-f0b8c2d71e79 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392658 Oct 23 19:59:12.045186 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 19:59:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:12.051134 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-63ef79e9-ce95-4002-9335-2d485ea8b63f admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:12.065833 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-63ef79e9-ce95-4002-9335-2d485ea8b63f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018280 Oct 23 19:59:12.066382 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 19:59:12.076414 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:12.091707 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019346 Oct 23 19:59:12.092242 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 23 19:59:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 19:59:12.101219 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-b0c5b060-217b-4615-90d7-61bdd64e4a55 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:12.106069 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.wsgi [None req-b0c5b060-217b-4615-90d7-61bdd64e4a55 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-b0c5b060-217b-4615-90d7-61bdd64e4a55 admin admin] Request method failure captured: Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept: application/json Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Accept-Encoding: gzip, deflate Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Connection: keep-alive Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Content-Length: 0 Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Host: 10.222.0.13 Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-Api-Version: compute 2.92 Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Openstack-System-Scope: None Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: User-Agent: python-novaclient Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Auth-Token: gAAAAABjVZ0PlqHLAH7NJsqidG-9cstNRAp2J6BTdQYXBcOlYW0sid60m2xA-djVyHjbgbvj0K0ZD88ULbX7GloZPJ2phDOM4bN4lTpWkCvfAf66FHTvv3GQpScgXecvy229v89xSoOCnCYa7qAnsFX89VftfweESoPWrRLEy4gDnJHfnI-KG6s Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Id: None Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Domain-Name: None Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Identity-Status: Confirmed Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Is-Admin-Project: True Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Id: default Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Domain-Name: Default Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Project-Name: admin Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Role: member,admin,reader Oct 23 19:59:12.107613 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Roles: member,admin,reader Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6d0fd21d5e64f76b7baefae60befbed", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6d0fd21d5e64f76b7baefae60befbed"}]}] Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant: admin Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Id: c6d0fd21d5e64f76b7baefae60befbed Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-Tenant-Name: admin Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User: admin Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Id: default Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Domain-Name: Default Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Id: 55e5de29fcfb4f0abcb119685810b1da Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: X-User-Name: admin Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: method: > Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: exception: Flavor 451 could not be found. Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: action_args: {'id': '451'} Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 19:59:12.109059 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:12.109818 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: ERROR nova.api.openstack.wsgi Oct 23 19:59:12.110932 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-b0c5b060-217b-4615-90d7-61bdd64e4a55 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 19:59:12.111916 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-b0c5b060-217b-4615-90d7-61bdd64e4a55 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011228 Oct 23 19:59:12.111916 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 19:59:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:13.298314 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:13.299329 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 23 19:59:13.299729 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:13.813950 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-7e078fd9-a108-4342-8804-94106731412f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:59:13.833572 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-7e078fd9-a108-4342-8804-94106731412f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.399841 Oct 23 19:59:13.834110 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 19:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 19:59:15.024028 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:15.025063 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 23 19:59:15.025457 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:15.549070 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-11b95c11-8c51-4a8c-95c9-fd856a2a7204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:59:15.567763 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-11b95c11-8c51-4a8c-95c9-fd856a2a7204 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404372 Oct 23 19:59:15.568245 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 19:59:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 19:59:16.767881 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:16.768940 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 23 19:59:16.769410 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:17.287713 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-025b59ed-9c03-42e6-a96e-ac85d978ea4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:59:17.306676 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-025b59ed-9c03-42e6-a96e-ac85d978ea4c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401821 Oct 23 19:59:17.307227 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 19:59:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:59:18.501067 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:18.502091 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 23 19:59:18.502518 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:19.023572 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-b7b3a4af-eb9c-4d1f-adf2-e860a9b3222c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 19:59:19.041499 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-b7b3a4af-eb9c-4d1f-adf2-e860a9b3222c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399039 Oct 23 19:59:19.042581 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 23 19:59:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 19:59:20.234950 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:20.235966 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 23 19:59:20.236371 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 19:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 19:59:20.755398 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-e65a2c6b-4be1-4679-8c28-2cbbdd2b2fb8 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 19:59:20.777103 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-e65a2c6b-4be1-4679-8c28-2cbbdd2b2fb8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403453 Oct 23 19:59:20.777636 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Oct 23 19:59:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:00:16.595294 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:16.596338 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-472965ac-d863-42ab-9d6e-4cbce9759df3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 23 20:00:16.596744 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 23 20:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:00:16.607800 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:16.990035 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-1bc277e4-c4ed-438b-a619-beefa3e9718b admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:17.010270 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-1bc277e4-c4ed-438b-a619-beefa3e9718b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406848 Oct 23 20:00:17.010831 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 23 20:00:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:00:17.033187 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_api:SELECT=14 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:17.036924 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-3a2799b5-a74b-4f2a-a104-18f426a09236 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:17.044695 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-3a2799b5-a74b-4f2a-a104-18f426a09236 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012991 Oct 23 20:00:17.045237 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 23 20:00:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:00:17.056813 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-a4586bb0-fb04-487b-a4d2-793d5a441d0e admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:17.063914 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-a4586bb0-fb04-487b-a4d2-793d5a441d0e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010733 Oct 23 20:00:17.064414 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 23 20:00:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:00:17.075804 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:17.082833 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010503 Oct 23 20:00:17.083344 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 23 20:00:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:00:17.095533 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-33d82be9-bf18-4b15-b617-7f0768435858 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:00:17.103450 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-33d82be9-bf18-4b15-b617-7f0768435858 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 Oct 23 20:00:17.104733 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 23 20:00:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:03:16.522648 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:16.523684 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Oct 23 20:03:16.524080 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 20:03:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:03:16.664567 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_api:SELECT=6 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:16.823622 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:16.828437 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:16.828960 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:16.829393 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:16.830113 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:16.830594 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:16.831042 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:16.862058 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-5bc06f7d-78cf-47ad-b951-30e3db568896 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198705 Oct 23 20:03:16.862637 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 20:03:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:03:17.926085 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:17.927159 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 23 20:03:17.927580 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 20:03:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:03:18.118041 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:18.121521 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:18.121996 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:18.122459 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:18.123182 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:18.123631 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:18.124048 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:18.143208 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-d0b97d3a-1278-439d-8872-243d8cf29582 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077068 Oct 23 20:03:18.143745 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 20:03:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:03:29.583861 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:29.584875 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 23 20:03:29.585269 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 20:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:03:29.732094 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_cell0:SELECT=4 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:29.732834 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_cell1:SELECT=4 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:29.733465 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG dbcounter [-] [103875] Writing DB stats nova_api:SELECT=8 {{(pid=103875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:29.782153 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:29.785551 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:29.786029 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:29.786489 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:29.787202 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:29.787648 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:29.788061 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:29.813422 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-71f46fae-8df4-4990-8c91-1e3be08bafbf admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086206 Oct 23 20:03:29.813900 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 20:03:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:03:30.864686 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG nova.api.openstack.wsgi [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] Calling method '>' {{(pid=103876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:30.865699 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: INFO nova.api.openstack.requestlog [None req-fa63f33f-34b6-47b5-9ca2-0ad9dc728702 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 23 20:03:30.866097 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: [pid: 103876|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 23 20:03:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:03:31.052949 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG nova.api.openstack.wsgi [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Calling method '>' {{(pid=103875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:03:31.056388 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:31.056871 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:31.057326 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:31.058047 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:03:31.058535 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:03:31.058954 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: DEBUG oslo_concurrency.lockutils [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:03:31.080750 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: INFO nova.api.openstack.requestlog [None req-cfc7fb59-80e9-4b92-9bb0-2c9c678b179f admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079098 Oct 23 20:03:31.081244 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: [pid: 103875|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 23 20:03:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:04:26.529006 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: Sun Oct 23 20:04:26 2022 - graceful shutdown triggered... Oct 23 20:04:26.529508 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: Gracefully killing worker 2 (pid: 103876)... Oct 23 20:04:26.529129 dv-cinder-862432-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 23 20:04:26.530342 dv-cinder-862432-1-iscsi devstack@n-api.service[103875]: Gracefully killing worker 1 (pid: 103875)... Oct 23 20:04:26.656608 dv-cinder-862432-1-iscsi devstack@n-api.service[103876]: DEBUG dbcounter [-] [103876] Writing DB stats nova_api:SELECT=4 {{(pid=103876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:04:27.530145 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: worker 1 buried after 1 seconds Oct 23 20:04:27.530706 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: worker 2 buried after 1 seconds Oct 23 20:04:27.530706 dv-cinder-862432-1-iscsi devstack@n-api.service[103874]: goodbye to uWSGI. Oct 23 20:04:27.531741 dv-cinder-862432-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 23 20:04:27.532294 dv-cinder-862432-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 23 20:04:27.535141 dv-cinder-862432-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 20:04:27.546024 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 20:04:27 2022] *** Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: nodename: dv-cinder-862432-1-iscsi Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: machine: x86_64 Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: clock source: unix Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: pcre jit disabled Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: detected number of CPU cores: 4 Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: current working directory: / Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: detected binary path: /usr/bin/uwsgi-core Oct 23 20:04:27.548614 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: your processes number limit is 47680 Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: your memory page size is 4096 bytes Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: detected max file descriptor number: 2048 Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: lock engine: pthread robust mutexes Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: thunder lock: enabled Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 20:04:27.549343 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 20:04:27.590466 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: Python main interpreter initialized at 0x5612afaef9c0 Oct 23 20:04:27.590466 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: python threads support enabled Oct 23 20:04:27.590466 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: your server socket listen backlog is limited to 100 connections Oct 23 20:04:27.590466 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: your mercy for graceful operations on workers is 90 seconds Oct 23 20:04:27.590903 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 20:04:27.590903 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: *** Operational MODE: preforking *** Oct 23 20:04:27.591176 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: *** uWSGI is running in multiple interpreter mode *** Oct 23 20:04:27.591176 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: spawned uWSGI master process (pid: 118850) Oct 23 20:04:27.591380 dv-cinder-862432-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 23 20:04:27.591958 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: spawned uWSGI worker 1 (pid: 118866, cores: 1) Oct 23 20:04:27.592489 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: spawned uWSGI worker 2 (pid: 118867, cores: 1) Oct 23 20:04:27.592903 dv-cinder-862432-1-iscsi devstack@n-api.service[118850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 20:04:28.254358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 20:04:28.260368 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 20:04:29.500568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 20:04:29.500568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: from cryptography.utils import int_from_bytes Oct 23 20:04:29.501204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 20:04:29.501204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: from cryptography.utils import int_from_bytes Oct 23 20:04:29.502138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 20:04:29.502138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: from cryptography.utils import int_from_bytes Oct 23 20:04:29.502628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 20:04:29.502628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: from cryptography.utils import int_from_bytes Oct 23 20:04:31.965734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 20:04:31.966345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 20:04:31.966541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 20:04:31.966908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 20:04:31.967166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 20:04:31.967557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.967887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.968219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.968539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.968871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.969186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.969513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.969836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.970164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.970452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.970773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.971101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-1-iscsi {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.971431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.971743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.972057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.972381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.972691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.973014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.973323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.973825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.974296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.974613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.974926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.975267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.975585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.975898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.976218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.976532 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.976858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.977170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.978112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-1-iscsi {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.978456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.978776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.979092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.979511 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.979827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.980140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.980327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 20:04:31.980723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.980822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 20:04:31.980942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.981088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.981206 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 20:04:31.981417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.981522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 20:04:31.981727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 20:04:31.981822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.982845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983695 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.983958 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.984955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.985153 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.985266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.985590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.985697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-1-iscsi {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.985914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.986881 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.987839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.988933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989554 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.989966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.990957 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991183 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.991971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-1-iscsi {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992485 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.992897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.993685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.993784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994469 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.994991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995716 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.995964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996417 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.996916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.997868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.998834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:31.999953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000060 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.000891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.001844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002154 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.002813 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003332 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.003965 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.004994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.005938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.006919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.007860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.008066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.008171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.008375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.008520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.008710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.009489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.009603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.009719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.009835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.009951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.010972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.011078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.011183 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.011459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.011677 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.011799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.012130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.012263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.012374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.012654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.012795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.013065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.013204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.013371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.013598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.013728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.014013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.014188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.014377 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.014689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.014817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.015007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.015328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.015460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.015659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.015786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.015976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.016129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.016293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.016609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.016779 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.017099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.017284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.017439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.017704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.017873 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.018056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.018202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.018440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.018605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.018747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.018885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.019030 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.019171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.019346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.019591 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.019757 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.019909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.020070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.020212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.020351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.020496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.020634 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.020786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.020967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.021115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.021289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.021445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.022136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.022294 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.022532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.022642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.022782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.022870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.022870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.023032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.023255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.023386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.023386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.023549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.023643 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.023735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.023818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.023907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.024115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.024205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.024464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.024555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.024792 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.024883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.025111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.025209 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.025427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.025535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.025743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.025887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.026056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.026154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.026398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.026492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.026717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.026840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.027029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.027136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.027359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.027461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.027679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.027777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.027998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.028136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.028315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.028414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.028628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.028729 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.028946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 20:04:32.029260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.029994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.030950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031259 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.031912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032243 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.032944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.033808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.034772 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.035959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.036998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037531 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.037939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038162 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.038938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.039147 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.039252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.039484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.039574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.039814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.040448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.040640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.040742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.040966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.041916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042231 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.042982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043185 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.043900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.044815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045668 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.045977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.046962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.047931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.048989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049206 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049610 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.049934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.050903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.051840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052078 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052485 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.052811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053506 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.053962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054413 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.054944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.055034 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.055264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.055367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.056896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.057842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.058838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.059984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.060924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.061948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062333 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062611 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.062974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.063165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.063281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.063437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.063535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.065819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.065958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.066946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067125 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067445 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067618 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067700 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.067908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.068931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069638 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.069989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.070962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.071956 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072269 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.072916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.073072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.073305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.073547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.073644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.073863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.074178 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.074304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.074523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.074752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.074844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.075151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.075240 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.075465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.075780 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.075879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.076095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.076403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.076490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.076720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.076994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.077140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.077507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.077598 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.077858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.077983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.078190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.078313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.078580 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.078837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.078928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.079240 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.079476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.079574 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.079852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.079943 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080185 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.080908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.081840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082487 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.082806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083728 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.083922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084319 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.084945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085576 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.085903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.086120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.086217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.086534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.086625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.087403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.087500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.087711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.087811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088024 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.088997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.089941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090304 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090772 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.090915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.091947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092157 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092246 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.092876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.093824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.094778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095311 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.095744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.096995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097096 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.097858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098026 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.098890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.099035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.099204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.099335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.099765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.099902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100171 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.100863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.101176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.101279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.101553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.101656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.101945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.102104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.102271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.102456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.103329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.103486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.103634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.103788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.103944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104356 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.104946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.105882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.106977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.107930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.108163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.108344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.108488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.108786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.108907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109698 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.109916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.110050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.110331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.110477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.110675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.110815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.111935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.112988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.113926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114147 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.114895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.115833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116060 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116683 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.116993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.117926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.118914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119540 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.119938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120477 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.120877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.121812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.122999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.123097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.123307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.123626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.123726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.123940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124352 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124568 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.124997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.125920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126285 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.126884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127728 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.127838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.128995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.129935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.130916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131550 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131680 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.131870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.132831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.133951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134134 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134509 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.134804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.135973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136779 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.136935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.137853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.138954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.139830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.140992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.141939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.142276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.142370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.142587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.142680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.142900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143001 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.143988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.144934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145565 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.145895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.146855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.147828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.148797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.149019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.149120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.149873 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.149976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.150197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.150348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.150631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.150746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.150948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.151998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.152935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.153963 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.154193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.154357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.154521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.154613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.154900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155147 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.155860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156175 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.156802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157158 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.157998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158443 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.158991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159094 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.159939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160345 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.160977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.161913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.162137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.162401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.162495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.162739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.162832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.163799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164441 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.164744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.165507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.165614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.165825 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.165952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166815 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.166931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.167896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168210 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.168837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169752 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169752 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.169955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.170968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171068 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171591 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171904 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.171995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.172931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173453 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.173875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.174851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175379 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.175910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.176904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.177991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.178941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.179927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.180852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.181067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.181296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.181608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.181718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.181943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182278 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.182929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.183966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.184914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185760 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.185865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.186835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187161 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.187836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.188990 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189304 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.189927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.190978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.191924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.192891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.193112 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.193202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.193672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.193842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.193981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.194206 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.194368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.194553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.194732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.194895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.195999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.196245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.196340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.196581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.196850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.196944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.197919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198485 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.198973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.199895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200255 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200767 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.200929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.201881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.202900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.203840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204381 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204703 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.204841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205333 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.205970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.206938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207352 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.207991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.208936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209251 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.209885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210792 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.210893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.211113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.211204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.211423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.211526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212269 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.212992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.213951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.214160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.214276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.214501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.214626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.214858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.215041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.215148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.215375 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.215476 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.215758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.216070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.216382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.216704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.216804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.217936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218396 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.218872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.219817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.220090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.220278 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.220623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.220949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.221309 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.221687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.221845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.221934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.222032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.222391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.222522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.222722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.222867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.223114 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.223223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.223468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.223613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.223871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224695 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.224872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.225885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226878 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.226995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.227200 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.227315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.228819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.229799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.230803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231690 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.231795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232661 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.232978 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.233939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.234933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235243 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.235974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.236927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.237871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238087 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.238849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239379 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 20:04:32.239751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.239989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.240302 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.240613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.240927 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.241263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.241547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.241857 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.242170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.242525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.242865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.243350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.243556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.244010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.244366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.244796 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.245086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.245420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.245751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.248190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.248544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.248916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.249261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.249601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.249944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.250667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.250890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.251227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.251581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.251929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.252260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.252609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.252946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.253285 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.253616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.253947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.254321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.254652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.254981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.255306 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.255634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.255962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.256300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.256681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.256948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.257281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.257610 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.257950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.258417 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.258782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.259123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.259465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.259954 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.260406 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.260593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.260853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.261223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.261552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.261874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 20:04:32.262125 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 20:04:32.302808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO dbcounter [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Registered counter for database nova_api Oct 23 20:04:32.323223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_db.sqlalchemy.engines [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.328012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO dbcounter [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Registered counter for database nova_api Oct 23 20:04:32.330010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writer thread running {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.348369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_db.sqlalchemy.engines [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.355730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writer thread running {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.387442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.context [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ff9404b-133d-4e93-bd33-12d6dd4a8031(cell1) {{(pid=118867) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 20:04:32.391608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:04:32.392085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:04:32.393668 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:04:32.394431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:04:32.394879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:04:32.396901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:04:32.398954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO dbcounter [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Registered counter for database nova_cell0 Oct 23 20:04:32.403718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO dbcounter [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Registered counter for database nova_cell1 Oct 23 20:04:32.411415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_db.sqlalchemy.engines [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.412896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.context [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ff9404b-133d-4e93-bd33-12d6dd4a8031(cell1) {{(pid=118866) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 20:04:32.416802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writer thread running {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.417452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_db.sqlalchemy.engines [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.417646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:04:32.418100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:04:32.419758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:04:32.420514 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:04:32.420972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:04:32.423053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:04:32.425124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO dbcounter [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Registered counter for database nova_cell0 Oct 23 20:04:32.429326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO dbcounter [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Registered counter for database nova_cell1 Oct 23 20:04:32.436724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_db.sqlalchemy.engines [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.440468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_db.sqlalchemy.engines [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.447682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writer thread running {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.449050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writer thread running {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.561860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writer thread running {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.570945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO dbcounter [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Registered counter for database nova_cell0 Oct 23 20:04:32.578565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_db.sqlalchemy.engines [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.583540 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writer thread running {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.598652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO dbcounter [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Registered counter for database nova_cell0 Oct 23 20:04:32.605484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_db.sqlalchemy.engines [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 20:04:32.611115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writer thread running {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 20:04:32.908033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: WARNING keystonemiddleware.auth_token [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 20:04:32.915755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: WARNING keystonemiddleware.auth_token [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 20:04:32.934547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: WARNING keystonemiddleware.auth_token [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 20:04:32.941995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: WARNING keystonemiddleware.auth_token [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 20:04:33.261179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: WARNING keystonemiddleware.auth_token [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 20:04:33.267118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: WARNING keystonemiddleware.auth_token [None req-2737bf00-515c-4203-92bd-882fbbd37db6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 20:04:33.272433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612afaef9c0 pid: 118867 (default app) Oct 23 20:04:33.285082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: WARNING keystonemiddleware.auth_token [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 20:04:33.291604 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: WARNING keystonemiddleware.auth_token [None req-0ebc26e5-3ee1-48a1-9a8f-7f517b23380f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 20:04:33.296937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612afaef9c0 pid: 118866 (default app) Oct 23 20:05:08.149441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:08.150590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:08.151533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:08.152424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:09.278793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:09.279630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:09.280467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:09.281145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:10.270810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cfdc8e48-c106-4be6-b2e3-28859c44203b tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Action: 'create', calling method: .version_select at 0x7f64f13e9ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1169433257", "metadata": {"Type": "work"}}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:10.705842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6a22447b-c4f8-4b28-bae6-91347bfc71be tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Action: 'create', calling method: .version_select at 0x7f64f13e7f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1686220548"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:12.682665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cfdc8e48-c106-4be6-b2e3-28859c44203b tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.542668 Oct 23 20:05:12.684306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 20:05:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4546 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 20:05:12.737490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7ceb9db1-1a3e-41ba-823c-357f5a0b7013 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f11f5d30>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:12.969960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7ceb9db1-1a3e-41ba-823c-357f5a0b7013 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 200 len: 353 microversion: 2.1 time: 0.260563 Oct 23 20:05:12.971568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:12 2022] GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 353 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:13.268138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6a22447b-c4f8-4b28-bae6-91347bfc71be tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.994408 Oct 23 20:05:13.279624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Oct 23 20:05:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3997 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 20:05:13.284641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ea66ef8b-8f39-4ade-a328-c758f4ab503e tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1189430>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:13.345214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ea66ef8b-8f39-4ade-a328-c758f4ab503e tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 200 len: 345 microversion: 2.1 time: 0.064842 Oct 23 20:05:13.346205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:13 2022] GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:13.988947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-17904e85-6034-40f7-9c5a-80321f6e1a66 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f11f6dc0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:14.105249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-17904e85-6034-40f7-9c5a-80321f6e1a66 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 200 len: 354 microversion: 2.1 time: 0.123362 Oct 23 20:05:14.107321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:13 2022] GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:14.123587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-82f98154-66a4-42d7-9e43-f17ffcb4bb51 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f1189b80>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:14.223908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-82f98154-66a4-42d7-9e43-f17ffcb4bb51 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 200 len: 354 microversion: 2.1 time: 0.107220 Oct 23 20:05:14.241737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:14 2022] GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:14.255887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9cfa6d8b-224c-489e-a257-37f2ca65ff39 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f1189550>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:14.362606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-311e9a83-82aa-4adb-9a38-c0dd372fc000 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f11f5d30>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:14.496060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-311e9a83-82aa-4adb-9a38-c0dd372fc000 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 200 len: 345 microversion: 2.1 time: 0.139417 Oct 23 20:05:14.496886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 5/7] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:14 2022] GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:14.677333 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9cfa6d8b-224c-489e-a257-37f2ca65ff39 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 202 len: 0 microversion: 2.1 time: 0.426400 Oct 23 20:05:14.680710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 3/8] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:05:14 2022] DELETE /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:05:14.688996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ff471b2a-bdb1-4c28-8df7-63022bee1e7e tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f1189a60>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:14.801966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ff471b2a-bdb1-4c28-8df7-63022bee1e7e tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 200 len: 353 microversion: 2.1 time: 0.115474 Oct 23 20:05:14.802963 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 6/9] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:14 2022] GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:15.510718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-00478a55-e677-4a1f-9ef6-a3dfd8451c8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1189c10>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:15.679680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-00478a55-e677-4a1f-9ef6-a3dfd8451c8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 200 len: 346 microversion: 2.1 time: 0.172661 Oct 23 20:05:15.680305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 4/10] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:15 2022] GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:15.694788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-101b073c-60fd-4374-82ca-02750bc494c1 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Action: 'create', calling method: .version_select at 0x7f64f11893a0>, body: {"snapshot": {"volume_id": "346aaa80-e78c-4e3e-a0a0-d0f366074526", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1621869521"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:15.821457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-59a85003-6300-4460-87ce-e7ccd7f05c07 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Calling method '.version_select at 0x7f64f1189b80>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:16.053554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-59a85003-6300-4460-87ce-e7ccd7f05c07 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] HTTP exception thrown: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-59a85003-6300-4460-87ce-e7ccd7f05c07 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Request method failure captured: Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 HTTP/1.1 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ50N97B0Jy6a7kzBTsBZWa2tOJlpqPD1_HaLw2nF0KrwocnZyM4Zvojxgq02JWD44RK6LkNmHY0izd8WGyMaL_2sIXHveDNH9udMimOPbeQ394SFV1uJnlRoA22doMcQPPkwAP7Wa_HAsAUntX-CJ4LaauxjD3Dvo4nVNzgUhoIFMY Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 67e002b62fa7450b809a03d93496e7f1 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesGetTestJSON-472053697 Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:05:16.060635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_67e002b62fa7450b809a03d93496e7f1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/67e002b62fa7450b809a03d93496e7f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67e002b62fa7450b809a03d93496e7f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67e002b62fa7450b809a03d93496e7f1"}]}] Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesGetTestJSON-472053697 Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 67e002b62fa7450b809a03d93496e7f1 Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesGetTestJSON-472053697 Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesGetTestJSON-472053697-project Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 8b4d77a96af94f71b76c7b00390b56a3 Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesGetTestJSON-472053697-project Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '862e0f5d-1775-4b3b-aff8-10ff30331679'} Oct 23 20:05:16.062783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. (HTTP 404) (Request-ID: req-e115be41-b9b7-4994-a05b-eb5c41b516eb) Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:16.066391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:16.070922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 20:05:16.075142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-59a85003-6300-4460-87ce-e7ccd7f05c07 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] Returning 404 to user: Volume 862e0f5d-1775-4b3b-aff8-10ff30331679 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-59a85003-6300-4460-87ce-e7ccd7f05c07 tempest-VolumesGetTestJSON-472053697 tempest-VolumesGetTestJSON-472053697-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679" status: 404 len: 109 microversion: 2.1 time: 0.244720 Oct 23 20:05:16.081520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:15 2022] GET /compute/v2.1/os-volumes/862e0f5d-1775-4b3b-aff8-10ff30331679 => generated 109 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:05:16.149478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-101b073c-60fd-4374-82ca-02750bc494c1 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.459476 Oct 23 20:05:16.150784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 7/12] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 23 20:05:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:16.165706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3134c6d5-1c23-4320-b478-e53ebd3cb77e tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1b74430>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:16.254555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3134c6d5-1c23-4320-b478-e53ebd3cb77e tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.097269 Oct 23 20:05:16.255793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:16 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:16.267905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3ac7411f-147a-41e2-a4a4-b10d0d167d6f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1189160>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:16.377007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3ac7411f-147a-41e2-a4a4-b10d0d167d6f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113151 Oct 23 20:05:16.378161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 23 20:05:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:16.389348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5c792c04-75c9-4810-bc97-30ca1281188f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1157790>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:16.447521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5c792c04-75c9-4810-bc97-30ca1281188f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.061911 Oct 23 20:05:16.449327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:16 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:17.461381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b5782a2f-22e1-4f58-9a5f-5b9f7b498462 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1194a60>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:17.529904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b5782a2f-22e1-4f58-9a5f-5b9f7b498462 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.072643 Oct 23 20:05:17.530811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:17 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:18.340938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1010819598", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "networks": [{"uuid": "ce1dcb9b-0da9-45b0-9d47-fb686a4f087d"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:18.544761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b7a688b0-fe14-4010-adc4-ddc22fbc6513 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f1194310>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:18.592996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] validate_networks() for [('ce1dcb9b-0da9-45b0-9d47-fb686a4f087d', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:05:18.616049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b7a688b0-fe14-4010-adc4-ddc22fbc6513 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.074989 Oct 23 20:05:18.617755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 10/17] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:18 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:19.631587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-95b5e024-1f9f-49d8-8cba-62ef19062a8b tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f11f5af0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:19.690584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-95b5e024-1f9f-49d8-8cba-62ef19062a8b tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.064250 Oct 23 20:05:19.696484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 11/18] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:19 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:20.251466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:05:20.258559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:05:20.259330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:05:20.259985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:05:20.260567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:05:20.299585 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:20.302639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:20.304704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:20.307293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:20.315035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:20.315520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:20.409072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Getting quotas for project dd03c05196b64299bf41b7d4c412070a. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:20.443581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Getting quotas for user a571b802668942e2b612ef125fe34ea6 and project dd03c05196b64299bf41b7d4c412070a. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:20.484330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:05:20.487229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:05:20.679975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1b7cb7a3-2545-43f4-95c4-87bdcba6c60d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.665771 Oct 23 20:05:20.682723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 8/19] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:05:20.696819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-67b65c35-dab3-4cca-981f-49924029009d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:20.700055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-67b65c35-dab3-4cca-981f-49924029009d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:20.730906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a4280af5-ab03-46e1-a150-94bde5b955b5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f106eb80>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:20.845357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a4280af5-ab03-46e1-a150-94bde5b955b5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.137122 Oct 23 20:05:20.846316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:20 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:20.967497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-67b65c35-dab3-4cca-981f-49924029009d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:21.000237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-67b65c35-dab3-4cca-981f-49924029009d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1215 microversion: 2.1 time: 0.308669 Oct 23 20:05:21.003065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 12/21] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:20 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:21.859453 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d0e02a9a-1a63-4cf7-8c47-c3f50da55a0d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f0808310>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:21.969263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d0e02a9a-1a63-4cf7-8c47-c3f50da55a0d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.114634 Oct 23 20:05:21.970643 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 10/22] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:21 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:22.026806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dd1e341b-eb35-4018-b919-974202eb4b52 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:22.027629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dd1e341b-eb35-4018-b919-974202eb4b52 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:22.178639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dd1e341b-eb35-4018-b919-974202eb4b52 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:22.206953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dd1e341b-eb35-4018-b919-974202eb4b52 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1215 microversion: 2.1 time: 0.184528 Oct 23 20:05:22.210336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:22 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:22.988137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a2b546b7-e851-4e44-b704-91666fe1333f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f115e280>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:23.046166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a2b546b7-e851-4e44-b704-91666fe1333f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.066899 Oct 23 20:05:23.046807 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 14/24] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:22 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:23.238198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:23.239223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:23.260000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:23.262437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:23.263697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:23.268944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:23.270634 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:23.270977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:23.294005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a5bf051b-3343-48cf-b5b6-0325c379e3b2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: .version_select at 0x7f64f106eca0>, body: {"keypair": {"name": "tempest-keypair-910178489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALgChb6q4if+kLrXxHCNGtcLjy6P5n4u9MeO2HonGIlPFZsSmvaBWiY3B01mUMxQgRISUeeY6OFPFopMHmAi4MYIoE6NYd0POboTr1knwzGbkSFnZ+v8BbZj8H2P39U1g=="}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:23.343071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-a5bf051b-3343-48cf-b5b6-0325c379e3b2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:23.354694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-a5bf051b-3343-48cf-b5b6-0325c379e3b2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for user 7aca00ea597140c5be97a6a4fa33f9c7 and project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:23.404865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a5bf051b-3343-48cf-b5b6-0325c379e3b2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.429401 Oct 23 20:05:23.405915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 11/25] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:05:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:23.752802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:23.781962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f03bcde7-3a87-4696-a101-e58405fdcad3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1219 microversion: 2.1 time: 0.542342 Oct 23 20:05:23.789443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 15/26] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:23 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1219 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:24.070931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-20ff0bf7-ee02-43b1-90e5-736062fed63a tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f080d4c0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:24.127217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-20ff0bf7-ee02-43b1-90e5-736062fed63a tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.071363 Oct 23 20:05:24.127736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:24 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:24.808348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:24.809688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:24.817969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:24.819121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:24.819875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:24.821029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:24.822642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:24.823347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:24.983347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:24.998711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-78465452-8379-4841-b7ff-eb679bcbe2ff tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1219 microversion: 2.1 time: 0.193544 Oct 23 20:05:24.999318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:24 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:25.143656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0042f939-dfd1-4223-b25a-e7655eb6e0a8 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f106ea60>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:25.215833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0042f939-dfd1-4223-b25a-e7655eb6e0a8 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.077614 Oct 23 20:05:25.220995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 13/29] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:25 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:25.412116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6b92425a-4685-4245-97d9-c78f5f5d0cdd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: .version_select at 0x7f64f10f7310>, body: {"keypair": {"name": "tempest-keypair-1643625100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz0oUfJrxJ8+KwFaOQGeraeErWSqWkPyZpUuAbfmVXMq0KkwEE8gg9D+/pG+ysgWvrYpHZrKJ1dqo9RlkfpqNLmu+LMHrcgBUg/5uzrJxaoHvBCBJjdjzdHnJgszgZzag=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:25.471816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-6b92425a-4685-4245-97d9-c78f5f5d0cdd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for project 4023fb7431ad496fa044b19190f014d8. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:25.488600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-6b92425a-4685-4245-97d9-c78f5f5d0cdd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for user 7cef68ee160348dea427e6c46b775e2d and project 4023fb7431ad496fa044b19190f014d8. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:25.560722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6b92425a-4685-4245-97d9-c78f5f5d0cdd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.359084 Oct 23 20:05:25.563877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 17/30] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 23 20:05:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 363 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 20:05:26.027700 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:26.032114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:26.091528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:26.092314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:26.092933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:26.094481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:26.097577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:26.101618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:26.229107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94de58f7-f05a-470b-a52e-b7cb4a5328ef tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f10153a0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:26.295378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-94de58f7-f05a-470b-a52e-b7cb4a5328ef tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.069366 Oct 23 20:05:26.296308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 18/31] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:26 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:26.645428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:26.685720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3c269913-f384-4c8e-818f-3a2c68392ea6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1267 microversion: 2.1 time: 0.660963 Oct 23 20:05:26.686805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 14/32] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:26 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1267 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:27.062793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1365048209", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:27.195497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] validate_networks() for [('4fadb6cf-3557-4130-bf6c-5eb0e0fb1ad2', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:05:27.308730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8a4a9a81-e54a-4216-baa0-b0dc716c7bd1 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f0747af0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:27.361652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8a4a9a81-e54a-4216-baa0-b0dc716c7bd1 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 288 microversion: 2.1 time: 0.056735 Oct 23 20:05:27.362727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 15/33] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:27 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:27.373916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f6b14155-49ed-41d1-bda6-41ba13725ca5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f0756280>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:27.477596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f6b14155-49ed-41d1-bda6-41ba13725ca5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 202 len: 0 microversion: 2.1 time: 0.107298 Oct 23 20:05:27.478362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 16/34] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 23 20:05:27 2022] DELETE /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:05:27.487972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b305747f-8646-47dc-b15c-16d2c88e892f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f06f8670>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:27.582143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b305747f-8646-47dc-b15c-16d2c88e892f tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.099250 Oct 23 20:05:27.582999 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:27 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:27.715555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:27.717903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:27.747639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:27.749047 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:27.749547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:27.750740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:27.756572 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:27.757033 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:28.001844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:28.015889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f1379a41-62b4-4866-8054-bed2bd8b7009 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1275 microversion: 2.1 time: 0.306465 Oct 23 20:05:28.041910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 18/36] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:27 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1275 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:28.594843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9928f836-4a82-4eea-a485-20255d99b564 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f06f8700>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:28.653248 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9928f836-4a82-4eea-a485-20255d99b564 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.062800 Oct 23 20:05:28.653834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 19/37] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:28 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:28.661621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1769834635", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e3b82ee-7488-4576-9263-10150a8cce41"}], "security_groups": [{"name": "tempest-securitygroup--529744718"}], "key_name": "tempest-keypair-910178489", "user_data": "}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:28.670629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:05:28.671830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:05:28.672563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:05:28.673180 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:05:28.673707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:05:28.690542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:28.691303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:28.692156 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:28.699284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:28.701117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:28.704437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:28.761050 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:28.770029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for user 4b6a101d23df4b62ba7e0c35d28d2a3c and project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:28.798892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:05:28.814733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:05:28.929252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5023f1d9-541d-4814-b518-d6f5bedc2078 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.179616 Oct 23 20:05:28.930122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 19/38] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:05:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:05:28.955998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6d99cb41-241f-41c7-9ff3-642bad832659 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:28.975060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6d99cb41-241f-41c7-9ff3-642bad832659 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:29.026449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] validate_networks() for [('8e3b82ee-7488-4576-9263-10150a8cce41', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:05:29.168469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6d99cb41-241f-41c7-9ff3-642bad832659 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:29.190739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6d99cb41-241f-41c7-9ff3-642bad832659 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1222 microversion: 2.1 time: 0.250987 Oct 23 20:05:29.192493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:28 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:29.208863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:29.209499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:29.253837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:29.255164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:29.255727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:29.256545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:29.257711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:29.270805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:29.615840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:29.624886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-279dac48-37c4-43a3-a760-689c8b439017 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1275 microversion: 2.1 time: 0.428944 Oct 23 20:05:29.628913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 21/40] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:29 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1275 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:29.643286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-331962155", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:29.770783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] validate_networks() for [('4fadb6cf-3557-4130-bf6c-5eb0e0fb1ad2', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:05:30.364188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:30.503366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:05:30.503865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:05:30.504347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:05:30.504767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:05:30.505239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:05:30.542089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:30.543910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:30.544534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:30.547265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:30.549793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:30.550445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:30.605735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:30.624342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for user 7aca00ea597140c5be97a6a4fa33f9c7 and project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:30.672133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:05:30.677841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:05:30.764421 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a6cbb6bd-6942-4cce-818b-8395efde0d28 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.108485 Oct 23 20:05:30.772512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:05:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:05:30.783759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e39ddf82-d28c-4175-a93a-1968465986da tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f0704160>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:30.832473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e39ddf82-d28c-4175-a93a-1968465986da tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 200 len: 287 microversion: 2.1 time: 0.054618 Oct 23 20:05:30.833059 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 21/42] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:30 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:30.891921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1119895168", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d42fdacc-7ef9-4dc3-a526-50a70d71365d"}], "security_groups": [{"name": "tempest-securitygroup--593047306"}], "key_name": "tempest-keypair-1643625100", "user_data": "}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:31.086503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:05:31.087049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:05:31.087392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:05:31.088374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:05:31.088802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:05:31.113341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:31.113851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:31.114293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:31.119408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:31.120583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:31.121782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:31.174609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:31.187740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for user 4b6a101d23df4b62ba7e0c35d28d2a3c and project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:31.214025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:05:31.225632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:05:31.271695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] validate_networks() for [('d42fdacc-7ef9-4dc3-a526-50a70d71365d', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:05:31.474973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7aabfe29-ce3d-4c40-9a23-acf378563d9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.844930 Oct 23 20:05:31.484283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 22/43] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:05:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:05:31.518617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:31.521469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:31.553004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:31.556186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:31.556778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:31.558869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:31.559506 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:31.559847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:32.513393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:32.529452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-27e4c662-3458-4658-ac4f-b0cb3a2f7b10 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1273 microversion: 2.1 time: 1.042186 Oct 23 20:05:32.531856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 23/44] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:31 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1273 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:32.544596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:32.546972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:32.564277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:32.565322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:32.566026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:32.567903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:32.568956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:32.570874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.158031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:33.174402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-96144676-3c49-477c-bdda-d12cda161575 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1241 microversion: 2.1 time: 0.635032 Oct 23 20:05:33.179864 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 24/45] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:32 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1241 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:33.196893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:33.197530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:33.218024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.218354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.227191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.228945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.231170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.231471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.378993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:33.400033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f89228e5-849b-426e-90e3-1fd213f5b87f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1225 microversion: 2.1 time: 0.212379 Oct 23 20:05:33.403424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 25/46] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:33 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:33.439353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6b871111-5e33-490b-b323-80535c379f74 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f075a160>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:33.532054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-6b871111-5e33-490b-b323-80535c379f74 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] HTTP exception thrown: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6b871111-5e33-490b-b323-80535c379f74 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Request method failure captured: Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 HTTP/1.1 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ51GjZuBOJ1WLz-rCPfKvc2uEwztAJ-MWxoy1SvY6o2nK-nlPFtrNmeEhxhe6e4_XdmQhVYF0L7cXQG6TME1LDMsDM48EpR7bEm-8C5yzJIfjmR7tC5tpiS3CVZyIJSKShG37MmfFMHOa0bEDoislHaqpmtWRRRrVjy4_Moh-r-tKQ Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:05:33.539712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ba293d8c83844d28dd78b7d14c66771", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}] Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 8c82afa51f3a482ba72051e95fac2713 Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '0bdc0594-2985-446d-a6dd-eed8ef38e1e8'} Oct 23 20:05:33.541357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. (HTTP 404) (Request-ID: req-4c88d6e7-a9e9-435f-b417-9cf0a03d68ce) Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.541979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:33.543388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 23 20:05:33.544258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6b871111-5e33-490b-b323-80535c379f74 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Returning 404 to user: Snapshot 0bdc0594-2985-446d-a6dd-eed8ef38e1e8 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:05:33.545228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6b871111-5e33-490b-b323-80535c379f74 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8" status: 404 len: 111 microversion: 2.1 time: 0.137186 Oct 23 20:05:33.549630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 26/47] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 23 20:05:33 2022] GET /compute/v2.1/os-snapshots/0bdc0594-2985-446d-a6dd-eed8ef38e1e8 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:05:33.566237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b818df36-e3c9-4011-8b8e-042ab916e6c5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f075aaf0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:33.792378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:05:33.796320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:05:33.797009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:05:33.797579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:05:33.798486 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:05:33.814522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.816818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.817301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.820882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.821383 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.821824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.861871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b818df36-e3c9-4011-8b8e-042ab916e6c5 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 202 len: 0 microversion: 2.1 time: 0.311069 Oct 23 20:05:33.864051 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 27/48] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:05:33 2022] DELETE /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:05:33.876572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:33.878280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:33.904377 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.907986 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.909467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.911247 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:33.913115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:33.914201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:33.931488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for project 4023fb7431ad496fa044b19190f014d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:05:33.953966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for user 7cef68ee160348dea427e6c46b775e2d and project 4023fb7431ad496fa044b19190f014d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:05:33.996799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:05:33.999236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:05:34.314055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-533a7899-38e3-448b-9b8d-ca88349160b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.477457 Oct 23 20:05:34.321120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 22/49] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 23 20:05:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3487 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 20:05:34.378727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7f7cd757-ba7a-477b-b2f0-3bb51a3e3583 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f06f8c10>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:34.485407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-7f7cd757-ba7a-477b-b2f0-3bb51a3e3583 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] HTTP exception thrown: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7f7cd757-ba7a-477b-b2f0-3bb51a3e3583 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Request method failure captured: Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 HTTP/1.1 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ51GjZuBOJ1WLz-rCPfKvc2uEwztAJ-MWxoy1SvY6o2nK-nlPFtrNmeEhxhe6e4_XdmQhVYF0L7cXQG6TME1LDMsDM48EpR7bEm-8C5yzJIfjmR7tC5tpiS3CVZyIJSKShG37MmfFMHOa0bEDoislHaqpmtWRRRrVjy4_Moh-r-tKQ Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:05:34.488458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ba293d8c83844d28dd78b7d14c66771", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}] Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 8c82afa51f3a482ba72051e95fac2713 Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '346aaa80-e78c-4e3e-a0a0-d0f366074526'} Oct 23 20:05:34.489757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. (HTTP 404) (Request-ID: req-e1b5393a-7b6b-435c-a133-91bdc65c29fb) Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:34.490537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:34.492216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 20:05:34.493292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:34.494372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:05:34.496091 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7f7cd757-ba7a-477b-b2f0-3bb51a3e3583 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Returning 404 to user: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:05:34.497434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7f7cd757-ba7a-477b-b2f0-3bb51a3e3583 tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 404 len: 109 microversion: 2.1 time: 0.171066 Oct 23 20:05:34.498089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 23/50] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:34 2022] GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:05:34.526914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:34.527590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:34.569535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:34.571841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:34.573023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:34.574534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:34.577575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:34.578914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:34.795640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:34.819412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-09676ded-15d6-42cb-b526-9fac63deb2e0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1297 microversion: 2.1 time: 0.319403 Oct 23 20:05:34.821203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 24/51] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:34 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1297 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:34.827738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:34.828569 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:35.095850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:35.117794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:35.119317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:35.146999 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-282efbfd-baf3-4f05-9196-a452c3bcbc91 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1282 microversion: 2.20 time: 0.324665 Oct 23 20:05:35.148867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 25/52] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:34 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1282 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:35.153793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:35.154582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:35.170730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:35.174111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:35.176693 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:35.180309 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:35.192295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:35.192967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:35.266648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:35.276953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9bfdbee6-c79a-4f2a-890f-91e0f0aa4e12 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 1.411059 Oct 23 20:05:35.285914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:33 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:35.290892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9ddad578-e695-4e9e-a52b-0f90c8c5bb8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f076dd30>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:35.359635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-9ddad578-e695-4e9e-a52b-0f90c8c5bb8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] HTTP exception thrown: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9ddad578-e695-4e9e-a52b-0f90c8c5bb8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Request method failure captured: Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 HTTP/1.1 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ51GjZuBOJ1WLz-rCPfKvc2uEwztAJ-MWxoy1SvY6o2nK-nlPFtrNmeEhxhe6e4_XdmQhVYF0L7cXQG6TME1LDMsDM48EpR7bEm-8C5yzJIfjmR7tC5tpiS3CVZyIJSKShG37MmfFMHOa0bEDoislHaqpmtWRRRrVjy4_Moh-r-tKQ Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:05:35.362674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ba293d8c83844d28dd78b7d14c66771", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}] Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 8c82afa51f3a482ba72051e95fac2713 Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '346aaa80-e78c-4e3e-a0a0-d0f366074526'} Oct 23 20:05:35.364015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. (HTTP 404) (Request-ID: req-0ee52083-e560-4af5-9cb4-2dfed2353e55) Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.364907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:05:35.366088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 20:05:35.367597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.368460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9ddad578-e695-4e9e-a52b-0f90c8c5bb8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Returning 404 to user: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:05:35.369833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9ddad578-e695-4e9e-a52b-0f90c8c5bb8d tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 404 len: 109 microversion: 2.1 time: 0.079477 Oct 23 20:05:35.373497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 29/54] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:05:35 2022] DELETE /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:05:35.384925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4ed87c3c-ca7e-4c50-8824-5315489460bb tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Calling method '.version_select at 0x7f64f076dca0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:35.456124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:35.465535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-4ed87c3c-ca7e-4c50-8824-5315489460bb tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] HTTP exception thrown: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.466324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4187fa3e-dfb6-4e9f-a624-0efee489db48 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.316223 Oct 23 20:05:35.466913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 26/55] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:35 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4ed87c3c-ca7e-4c50-8824-5315489460bb tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Request method failure captured: Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 HTTP/1.1 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ51GjZuBOJ1WLz-rCPfKvc2uEwztAJ-MWxoy1SvY6o2nK-nlPFtrNmeEhxhe6e4_XdmQhVYF0L7cXQG6TME1LDMsDM48EpR7bEm-8C5yzJIfjmR7tC5tpiS3CVZyIJSKShG37MmfFMHOa0bEDoislHaqpmtWRRRrVjy4_Moh-r-tKQ Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:05:35.480317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9ba293d8c83844d28dd78b7d14c66771", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9ba293d8c83844d28dd78b7d14c66771"}]}] Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 9ba293d8c83844d28dd78b7d14c66771 Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-236079369 Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 8c82afa51f3a482ba72051e95fac2713 Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-236079369-project Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '346aaa80-e78c-4e3e-a0a0-d0f366074526'} Oct 23 20:05:35.481650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. (HTTP 404) (Request-ID: req-d1fa5507-ea4c-41db-a242-13cedde1d1f2) Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.482435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:05:35.483556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 20:05:35.484398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. Oct 23 20:05:35.485454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:05:35.488054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4ed87c3c-ca7e-4c50-8824-5315489460bb tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] Returning 404 to user: Volume 346aaa80-e78c-4e3e-a0a0-d0f366074526 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:05:35.490350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4ed87c3c-ca7e-4c50-8824-5315489460bb tempest-VolumesSnapshotsTestJSON-236079369 tempest-VolumesSnapshotsTestJSON-236079369-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526" status: 404 len: 109 microversion: 2.1 time: 0.114689 Oct 23 20:05:35.491046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 30/56] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:05:35 2022] GET /compute/v2.1/os-volumes/346aaa80-e78c-4e3e-a0a0-d0f366074526 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:05:35.844058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:35.844713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:35.864669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:35.868245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:35.871407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:35.873377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:35.874068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:35.874773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:35.987295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.001695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f79dea20-5cc7-4370-a2e6-9b1f18ed7c43 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.161505 Oct 23 20:05:36.020111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 27/57] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:35 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:36.178498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:36.179951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:36.187853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.188573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.189205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.190956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.191566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.192576 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.277748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.292736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.299480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.300861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-20f461d2-0fdb-4f9d-960d-f4dd5f23c682 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1286 microversion: 2.20 time: 0.127946 Oct 23 20:05:36.302433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 31/58] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:36 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:36.313598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:36.315490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:36.328871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.330170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.330654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.331365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.331916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.332337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.577328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.593611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e39385d0-91da-41e1-92a0-7129ec0338d8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.282823 Oct 23 20:05:36.594231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:36 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:36.605369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:36.607334 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:36.617693 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.618302 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.618668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.619363 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.619806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.620216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.700021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a8bceb-1edb-49db-9c3c-9c8de07e1b2a", "tag": "e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:36.712935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:36.716595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.716595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.717124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.721039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b7dc508d-0552-49b5-bc72-2cd3463a8cce tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.123689 Oct 23 20:05:36.724556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 29/60] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:36 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:36.747006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Creating event network-changed:e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3 for instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a on hv-cinder-86243 Oct 23 20:05:36.747565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 20:05:36.747957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e5baa812-3a66-4ca3-b534-47229952f1b2 req-4639e67e-506d-4cd7-8502-637e44008e28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 20:05:36.750135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.751523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.754655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.755715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:36.756737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:36.757423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:36.773912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.compute.rpcapi [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 20:05:36.775329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] Releasing lock "compute-rpcapi-router" {{(pid=118867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 20:05:36.812121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-be2b81d5-97bc-468c-90f2-2b950a647672 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326624 Oct 23 20:05:36.812819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 32/61] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:05:37.030185 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:37.030891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:37.040475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.040960 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.041386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.042080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.044102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.044543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.114814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:37.123433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b9ee5d21-705a-44b4-ae05-3134123e0c55 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.099280 Oct 23 20:05:37.124178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 30/62] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:37 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:37.329801 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:37.330541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:37.354692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.354692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.355112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.355820 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.356349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.356827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.429726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:37.441045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:37.443566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:37.445659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4b2cb64b-3964-4947-acd8-645b9157522f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1286 microversion: 2.20 time: 0.121844 Oct 23 20:05:37.451131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 33/63] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:37 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:37.625399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:37.626219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:37.641616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.643095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.643555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.650501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.650501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.650501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.745837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:37.746855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:37.761297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.762139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.762888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:37.764061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:37.764726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:37.765482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:38.099361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.107758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9fa443dd-c012-4ad5-8428-24fe66727033 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.367598 Oct 23 20:05:38.111349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 34/64] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:37 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:38.145519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.147412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:38.148604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:38.156170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9f6667b4-89d1-4b17-8dce-aa1d47a3e231 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.535828 Oct 23 20:05:38.159402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:38.160084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:38.160828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:38.161400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:38.164284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:38.164761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:38.170738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 31/65] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:37 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:38.238230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.247063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-55c547d2-e551-4b1e-92d3-7a8bfb9bb23f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.103482 Oct 23 20:05:38.248177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 35/66] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:38 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:38.473018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:38.474868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:38.489165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:38.503459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:38.504141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:38.504908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:38.505380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:38.505803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:38.633052 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.641501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.643127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:38.644111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-320ac8e8-0f65-402d-b855-b5b133c8332f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1286 microversion: 2.20 time: 0.175802 Oct 23 20:05:38.644929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 32/67] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:38 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:39.133446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:39.134804 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:39.147368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.148396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.148827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.149527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.149971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.150591 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.183391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:39.184110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:39.196659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.201894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.202380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.203133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.203607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.204029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.260276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.276240 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b36240d4-b0ce-4c53-b6fe-7d157c276dda tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.146460 Oct 23 20:05:39.278279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 36/68] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:39 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:39.286912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:39.287521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:39.302230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.302793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.303248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.303920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.304416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.306283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.453491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.466393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7ad74667-9b23-4b0e-9769-db74a9efa0b7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.183674 Oct 23 20:05:39.468899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 37/69] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:39 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:39.493328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.501915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cc511a2d-3dd2-43a7-938f-f561e5deaa4d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.325897 Oct 23 20:05:39.516907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 33/70] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:39 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:39.671732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:39.672896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:39.690777 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.692678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.695072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.696478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:39.697677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:39.698967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:39.797823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.810802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.812893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:39.814344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-95606237-4a31-4b9f-ac32-9c000ff0a768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1286 microversion: 2.20 time: 0.148744 Oct 23 20:05:39.815364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 38/71] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:39 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:40.302924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:40.303667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:40.325465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:40.330750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.333253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.333964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.334744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.335339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.335716 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.460687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:40.470823 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dc506025-c4f4-4173-a9ee-ad4ef8c9efc7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.173614 Oct 23 20:05:40.484251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 34/72] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:40 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:40.490144 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:40.492052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:40.509327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.510215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.511727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.512567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.513258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.513883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.532629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:40.533679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:40.562625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.565928 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.575458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.576528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.577867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.578828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.645562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:40.665159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dc91bcce-2219-438a-a2a6-b6d0701032c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.178535 Oct 23 20:05:40.688108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 39/73] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:40 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:40.848989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:40.849945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:40.870808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.876099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.882819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.884131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:40.887572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:40.888317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:40.907015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:40.958596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:40.967478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5027558d-87cd-41d3-b637-ed6a48d89403 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.441368 Oct 23 20:05:40.972018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 35/74] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:40 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:41.078440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:41.104802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:41.116250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:41.119992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f5947572-3d27-408a-8345-febd49eca28f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1286 microversion: 2.20 time: 0.275044 Oct 23 20:05:41.121555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 40/75] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:40 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1286 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:41.500451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:41.501833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:41.517360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:41.518911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:41.519567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:41.521828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:41.524196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:41.524602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:41.702379 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:41.703766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:41.705914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=22 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:41.715084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:41.717507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:41.719620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:41.725578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:41.726964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:41.727604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:41.844742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:41.858601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-34f4c364-bdbd-4da1-bc01-6321940f72f8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1273 microversion: 2.1 time: 0.364916 Oct 23 20:05:41.859321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 36/76] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:41 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:41.893365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:41.926931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-79b5a1e0-21af-48be-b0a4-1e655bea482e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.227887 Oct 23 20:05:41.931762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:41 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:41.996707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:41.998342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:42.013810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.014730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.015450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.016410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.018886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.019578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.150931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:42.151568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:42.177941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.182314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.186204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.188042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.189950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.197005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.408995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:42.424463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:42.438791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:42.440004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0a3f7701-0fe3-4875-8ce1-bb904bb8bc76 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1278 microversion: 2.20 time: 0.295997 Oct 23 20:05:42.440511 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 42/78] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:42 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:42.527871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:42.537467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-aa42c067-1cbd-486f-98f5-ea1b2627af2e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.547060 Oct 23 20:05:42.543315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 37/79] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:41 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:42.890903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:42.892465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:42.911384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.914488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.916393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.918522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.919443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.921874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.959259 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:42.960556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:42.976127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.978986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.982940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:42.987000 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:42.990004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:42.991694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:43.062986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:43.243738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:43.256669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3f3098a9-4776-4990-814f-297dcfd4a13b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1281 microversion: 2.1 time: 0.372450 Oct 23 20:05:43.259132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 43/80] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:42 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1281 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:43.354893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:43.381746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1f0b7137-0ddf-4f84-9acc-8a8ecba1f974 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.424910 Oct 23 20:05:43.383577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 38/81] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:42 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:43.481249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:43.482502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:43.505041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:43.505849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:43.506749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:43.509820 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:43.511105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:43.513177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:43.572556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:43.573169 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:43.584884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:43.586236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:43.587963 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:43.589086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:43.592527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:43.593445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:43.813258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:43.831631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:43.836281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:43.842087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-578f2936-0463-4bab-a6ef-e63f58bcad55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.367917 Oct 23 20:05:43.844119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 44/82] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:43 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:43.852244 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:44.275712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.280569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:44.287010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5301d475-a402-45ea-a726-4cddeaab3da5 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.720306 Oct 23 20:05:44.289713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 39/83] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:43 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:44.291962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:44.295117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:44.310094 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.310940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.311612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.312797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.313451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.314349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.405369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.405556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:44.406158 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:44.416492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.416993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.418914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.420188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7477e74a-e01a-48ba-bf92-d226027de1d8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1291 microversion: 2.1 time: 0.143304 Oct 23 20:05:44.420534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.421246 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.423288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.436343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 45/84] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:44 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1291 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:44.505974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.514954 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-de1fddce-79dc-42c9-b7da-6655590e745b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1295 microversion: 2.1 time: 0.113397 Oct 23 20:05:44.515735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 40/85] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:44 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:44.627433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8837d8-442b-4b75-b896-e07e4a04391f", "tag": "2157f124-6d4c-4aa3-8b95-ee304dc9379e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:44.638033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.638753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.639264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.651436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] Creating event network-changed:2157f124-6d4c-4aa3-8b95-ee304dc9379e for instance df8837d8-442b-4b75-b896-e07e4a04391f on hv-cinder-86243 Oct 23 20:05:44.656544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-c8404074-d422-4344-b1fb-d2b340c20028 req-09f37520-bb4a-43a1-a3c0-b4b4a092bde0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196592 Oct 23 20:05:44.657227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 46/86] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:44.875975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:44.876667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:44.883265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.884385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.884826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.888084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:44.888689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:44.889404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:44.981624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.991993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.993827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:44.995160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-019899c3-8e0b-4ab4-b574-5b7b05f616f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.123646 Oct 23 20:05:44.995884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 41/87] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:44 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:45.311717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:45.313639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:45.321797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.323453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.324060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.324783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.325537 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.325967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.446400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:45.447183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:45.448876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=24 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:45.457732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.458300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.458883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.459699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.460226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.468504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.528390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:45.548809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b4601153-91dd-4bc4-89fb-35f88fce8d78 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.242776 Oct 23 20:05:45.560344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 47/88] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:45 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:45.576849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:45.576849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:45.576849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.577146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.577296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.578619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:45.579590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:45.580228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:45.597430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:45.620208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3a0d509b-f90e-45e4-98a5-7a75099654c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1291 microversion: 2.1 time: 0.178691 Oct 23 20:05:45.637724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 42/89] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:45 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1291 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:45.863570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:45.874528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6759d193-4d43-4629-8205-c8fdae1e1069 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.311075 Oct 23 20:05:45.875207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 48/90] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:45 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:46.023990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:46.026397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:46.040373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.041000 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.043153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.044044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.044603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.045164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.200233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:46.214883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:46.217390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:46.218938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6d9874c0-e911-4eec-b319-cc45933406f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.198962 Oct 23 20:05:46.220132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 43/91] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:46 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:46.577152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:46.577836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:46.593679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.594476 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.594909 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.608712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.609545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.613541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.648299 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:46.649561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:46.661946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.667109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.667807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.668747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.670433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.671635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.768949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:46.816776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:46.826661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-19cdc7e4-3794-4c05-a5e2-32f6b50f413f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1291 microversion: 2.1 time: 0.182582 Oct 23 20:05:46.827393 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 44/92] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:46 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1291 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:46.900385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:46.901836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:46.908366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.908851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.909662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.910517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:46.911303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:46.911878 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:46.933003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:46.943031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-aa513c44-7831-45a4-8102-43706215d753 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.371748 Oct 23 20:05:46.944293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 49/93] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:46 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:47.087498 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:47.098746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c4e04f72-c54a-4dfb-810c-a629b4a90e6f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.202493 Oct 23 20:05:47.099797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 45/94] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:46 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:47.244491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:47.245304 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:47.253541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.254238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.254769 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:47.255383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.255859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.256237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:47.329430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:47.342115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:47.343712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:47.344803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eaaf489a-0ce4-468f-a65b-b293f1db954f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.104832 Oct 23 20:05:47.345382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 50/95] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:47 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:47.851068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:47.851685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:47.858554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.859372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.860023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:47.861071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.861682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.862265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:47.940737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:47.955138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0d736caf-524a-4e5a-a14c-ccf003b83f90 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1291 microversion: 2.1 time: 0.108040 Oct 23 20:05:47.955979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 46/96] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:47 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1291 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:47.976689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:47.977286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:47.983352 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.984083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.984616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:47.985489 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:47.986013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:47.986463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.123251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:48.124219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:48.132901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.132901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.133376 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.133967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.134461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.134888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.135411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:48.144274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4f48d66c-ee2f-4b5e-ace9-cf4d1de14728 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.171501 Oct 23 20:05:48.146018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 51/97] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:47 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:48.299297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:48.309572 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cfc02e9c-8e49-454f-91d0-0cedbe0e2a97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.188012 Oct 23 20:05:48.309572 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 47/98] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:48 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:48.370977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:48.371785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:48.379089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.380241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.380698 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.381973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.382631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.383054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.451289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:48.461422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:48.463067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:48.464314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-583d04f4-7f3e-4337-8fd3-f66e57f44700 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.098487 Oct 23 20:05:48.464948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 52/99] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:48 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:48.980054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:48.980728 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:48.987077 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.987583 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.988193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:48.988956 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:48.989548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:48.989970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.064373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.081016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2b5357e3-372d-4825-99f3-b3d3fd39e19f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1291 microversion: 2.1 time: 0.106010 Oct 23 20:05:49.081897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 48/100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:48 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:49.168484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:49.169331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:49.175778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.176378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.176811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.177532 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.178004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.178441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.332398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:49.333771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:49.341040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.341687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.342499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.343272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.343885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.344592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.465006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.477815 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-60484f45-3c76-496a-9dfd-df098aab30fd tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.313073 Oct 23 20:05:49.490278 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 53/101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:49 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:49.490828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:49.503359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:49.509748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.510270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.510695 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.511398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:49.511851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:49.512273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:49.561666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.570611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-99d018e5-3760-4d5b-b9f2-e66a493dd68c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.242930 Oct 23 20:05:49.571715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 49/102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:49 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:49.578479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.588986 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.590657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:49.591768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-acbbf1e6-1fba-4279-909a-a67f98b64eb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1334 microversion: 2.20 time: 0.106576 Oct 23 20:05:49.592343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 54/103] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:49 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:50.106028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:50.106598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:50.145435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.147203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.148609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:50.149504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.150426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.152152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:50.323289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:50.338443 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4df1ab10-0dd3-4071-8a76-a7a1852d165d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1279 microversion: 2.1 time: 0.233974 Oct 23 20:05:50.344449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 50/104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:50 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:50.502478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:50.503111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:50.520038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.523139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.523857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:50.525075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.526469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.528150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:50.595624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:50.596258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:50.607018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.607518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.608067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:50.608783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:50.609345 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:50.609778 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:51.069817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:51.080979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1f1bd7da-4dfe-41e2-a975-2abc4b7a1106 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.582338 Oct 23 20:05:51.094442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 55/105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:50 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:51.104231 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:51.104850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:51.115633 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:51.118221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:51.118863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:51.119547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:51.121105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:51.126091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:51.169599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:51.182507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ea7befce-24a0-418a-9ebe-b07b2f79c56e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.591887 Oct 23 20:05:51.183344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 51/106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:50 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:51.355595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:51.363887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:51.364650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:51.370268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:51.372952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:51.374899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:51.375055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-51474d6c-1d81-4425-bd97-66bea7a7d272 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1340 microversion: 2.20 time: 0.279196 Oct 23 20:05:51.375600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:51.376311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:51.376600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 56/107] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:51 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1340 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:51.378114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:51.383898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:51.384653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.107493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:52.108021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:52.118686 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.119186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.119624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.120331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.120792 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.121214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.168211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.182911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:52.196037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9bc6b8ed-3b74-4543-b4b8-5f38f65d09c4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.835885 Oct 23 20:05:52.197286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 52/108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:51 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:52.214126 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:52.215377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:52.227177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.227962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.228606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.229717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.235428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.236188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.604122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.612445 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c60a2a4d-8220-4de6-b5e1-7a98b770c9d4 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.508692 Oct 23 20:05:52.613402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:52 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:52.629918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:52.630652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:52.641507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.641999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.642470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.643177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.643628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.644046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.700822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.710746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3d3cfc2c-1e86-4bbb-97ed-e0b52e1afde3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.506332 Oct 23 20:05:52.727089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:52 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:52.735616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3d6cd-5a81-425b-a929-808f46010e76", "tag": "e989a766-0552-40b5-acf0-9a2d7f1dfe99"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:52.749356 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.749838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.750523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.760457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.771401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.772953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:52.773202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Creating event network-changed:e989a766-0552-40b5-acf0-9a2d7f1dfe99 for instance 80f3d6cd-5a81-425b-a929-808f46010e76 on hv-cinder-86243 Oct 23 20:05:52.773914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 20:05:52.774064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ae791755-1d5d-4a98-9816-c34f0ce5f683 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1340 microversion: 2.20 time: 0.159496 Oct 23 20:05:52.774725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-02a9da55-8238-45bc-a467-3f47bf497699 req-7b7f8c71-d244-4fa0-8bfe-be17a581daef service nova] Acquired lock "compute-rpcapi-router" {{(pid=118866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 20:05:52.775959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.776422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.776999 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.778103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:52.778824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:52.779390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:52.781903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 58/111] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:52 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1340 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:52.810124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.compute.rpcapi [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 20:05:52.811178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] Releasing lock "compute-rpcapi-router" {{(pid=118866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 20:05:52.838807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3b1648e9-63af-44bf-b15a-7d682ea4a849 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109953 Oct 23 20:05:52.840245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 54/112] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:53.207821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea876cfc-08f7-40c4-bcd8-2b1f32738f30", "tag": "41d3538a-ad99-4c35-a478-c0aa5c437554"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:05:53.222607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.223116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.223725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.224340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:53.225147 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:53.243497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] Creating event network-changed:41d3538a-ad99-4c35-a478-c0aa5c437554 for instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 on hv-cinder-86243 Oct 23 20:05:53.244979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.245841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.246656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.247575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.248488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.249117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.252977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-861ee218-4350-4793-a1f5-f2f5de218f96 req-f9554546-651f-400d-a584-6709ed05e958 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048925 Oct 23 20:05:53.254187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 59/113] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:05:53.279986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:53.419829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.427647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c15b2f5a-3ddb-4609-8abe-a3533374c12e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.207946 Oct 23 20:05:53.428712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:53 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:53.637783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:53.638519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:53.645358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.646046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.646840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.648346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.648799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.649346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.741537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:53.742141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:53.748898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.749641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.750294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.751216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.751891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.752508 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.789161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.798102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ae6d1f09-6445-4726-adf8-9c3c8756e6d2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.164538 Oct 23 20:05:53.799357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 60/115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:53 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:53.809982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:53.810752 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:53.818554 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.819821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.820244 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.821113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:53.821812 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:53.822230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:53.932953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.941654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ee6bf85f-a96c-4078-87c7-fdcf40edddb7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.204552 Oct 23 20:05:53.942308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:53 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:53.978515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.987925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.989451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:53.990647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2dfdb7e3-8a6e-4baf-b9ea-ea41e4bc5191 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.184863 Oct 23 20:05:54.002437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 61/117] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:53 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:54.450369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:54.450986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:54.456962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.457444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.457877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.458597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.459051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.459468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.597151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:54.604895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fdd5ee65-c9cb-44b1-98d8-030e6740fea6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.158305 Oct 23 20:05:54.605474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:54 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:54.824481 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:54.825176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:54.831578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.832087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.832504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.833189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.833642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.834064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.965388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:54.966008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:54.966788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:54.972578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.973067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.973711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.974437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:54.974538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cdfc5c63-38c2-45a0-9913-79d8a88b90ae tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.154849 Oct 23 20:05:54.974897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:54.975324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:54.986426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 62/119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:54 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:55.015066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:55.016164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:55.023677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:55.025627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:55.026296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:55.027190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:55.027842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:55.028482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:55.164344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:55.172399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f8af6a17-90d5-4628-9a7b-12ed7b6a2333 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.210876 Oct 23 20:05:55.172982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 58/120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:54 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:05:55.208681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:55.216925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:55.218498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:55.219681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a1b622bf-6aa2-4d55-a095-90be8062955c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.208425 Oct 23 20:05:55.220339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 63/121] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:55 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:55.627579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:55.628234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:55.634386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:55.634865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:55.635290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:55.636051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:55.636590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:55.637009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:55.820646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:55.829319 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-608a6e36-9974-4bfa-b0a8-592f474572a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.205721 Oct 23 20:05:55.842530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 59/122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:55 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:55.996696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:55.997298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:56.003085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.003557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.004014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.004689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.005129 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.005545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.141440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:56.149631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d366023c-83e0-4167-b2b6-8d8cee38412a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.156662 Oct 23 20:05:56.150305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:55 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:56.196381 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:56.196981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:56.203144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.203663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.204077 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.204771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.205346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.205771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.245139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:56.248708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:56.251954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.252442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.252872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.253635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.254091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.254642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.377562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:56.388037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-94c8c93b-f12b-44d7-985c-9c36063de68e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.196279 Oct 23 20:05:56.388958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 60/124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:56 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:56.423368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:56.432259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:56.433687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:56.434935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-94aae524-8466-493e-b577-732ac8a3306f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.194092 Oct 23 20:05:56.435492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 65/125] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:56 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:56.852085 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:56.852697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:56.858555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.859045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.859471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.860439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:56.861050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:56.861480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:56.998817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.006292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-859c817e-6813-4681-8ae2-07b215d262fc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.158462 Oct 23 20:05:57.007446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:56 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:57.171852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:57.172456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:57.178334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.179305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.179730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.180411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.180863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.181358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.310521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.318428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4ddddc0c-2e61-40e3-bd1b-b4e9fd4cb011 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.150342 Oct 23 20:05:57.320061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 66/127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:57 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:57.411276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:57.411886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:57.418105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.418615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.419044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.419719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.420175 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.420592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.460899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:57.461502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:57.467678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.468408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.468934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.469687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:57.470139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:57.470613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:57.625300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.636434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a08589cc-7d4a-4967-9f46-6b327b5db7f0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.228858 Oct 23 20:05:57.637632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 62/128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:57 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:57.665715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.674434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.675882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:57.676945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2e9062ca-e73a-48d5-bdac-856334d3e42e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.220875 Oct 23 20:05:57.677675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 67/129] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:57 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:05:58.029493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:58.030104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:58.036086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.036564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.037002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.037676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.038177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.038623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.166197 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.173857 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fbec8a4b-3118-4cc9-92ac-1f4f8c4a0f50 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.148221 Oct 23 20:05:58.174459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 63/130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:58 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:58.342001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:58.342625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:58.348486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.348955 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.349374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.350037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.350532 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.350944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.477775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.486073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ff246103-988d-42d8-ae35-75b73f5aeab8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.147781 Oct 23 20:05:58.498391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 68/131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:58 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:58.659706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:58.660320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:58.667151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.667644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.668078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.668769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.669225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.669646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.702970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:58.703702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:58.710834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.711390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.711911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.712673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:58.713192 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:58.713677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:58.846714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.854848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1571c1fd-6e28-4989-95a1-c8963716c72b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.198985 Oct 23 20:05:58.855417 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:58 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:58.872175 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.880128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.881578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:58.883206 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-be625c17-ccde-4cd3-a7c0-f9907969452b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.184227 Oct 23 20:05:58.883744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 69/133] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:58 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:05:59.196568 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:59.197098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:59.203009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.203494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.203923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.204601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.205061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.205468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.329721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:59.338104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2820f724-004f-4ea9-bda8-bd60354fdf34 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.145799 Oct 23 20:05:59.338713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 65/134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:59 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:59.509415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:59.509952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:59.515803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.516278 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.516703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.517377 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.517824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.518239 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.648175 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:05:59.655791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a4a6ef4e-ee3e-41ef-8eb6-fef7a1b39025 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.150779 Oct 23 20:05:59.656353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 70/135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:59 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:05:59.877655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:59.878282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:59.884750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.885267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.885699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.886419 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.886877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.887301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.907521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:05:59.908120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:05:59.913927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.914440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.914869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:05:59.915547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:05:59.915994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:05:59.916413 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:00.080283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.088508 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0a7b9566-85dc-49f9-8b7b-ccc72cb2c55d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.214567 Oct 23 20:06:00.089242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 66/136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:05:59 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:00.089629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.099342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.101360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.102501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-52628939-e99b-4f1c-b933-0e711e4158e5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.198733 Oct 23 20:06:00.103199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 71/137] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:05:59 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:00.360917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:00.361523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:00.367520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:00.367994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:00.368415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:00.369083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:00.369528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:00.370017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:00.495993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.503831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0dac1a05-27d3-4022-8681-f91b0c61ec8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.146793 Oct 23 20:06:00.504387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 67/138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:00 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:00.678508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:00.679122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:00.684921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:00.685392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:00.685960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:00.686577 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:00.687029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:00.687450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:00.820274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:00.828696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-97f77545-2d04-4f1a-a19b-6e7338d3d704 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.153871 Oct 23 20:06:00.829327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:00 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:01.111320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:01.111921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:01.118329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.118813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.119268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.119949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.121795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.121795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.126823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:01.127422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:01.133201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.133819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.134406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.135034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.135954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.136524 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.321227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.324058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.329585 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3eebcc49-d0a3-43fa-b9c1-8627ba09b477 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.222080 Oct 23 20:06:01.330619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 68/140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:01 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:01.332630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.334127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.335868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5da4cd6b-470b-45fe-bec7-b1cb66e32ad7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.212853 Oct 23 20:06:01.336550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 73/141] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:01 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:01.527016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:01.527675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:01.533544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.534025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.534490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.535166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.535613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.536028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.663660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.671493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-de994971-7923-4854-ab03-f832fce60538 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.148275 Oct 23 20:06:01.672053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 69/142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:01 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:01.851730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:01.852363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:01.858108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.858619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.859048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.859725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:01.860179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:01.860636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:01.983470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:01.986951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:01.992060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a351a729-b240-48be-9511-06f9678d5330 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.144145 Oct 23 20:06:01.992670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:01 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:02.353657 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:02.354298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:02.359911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:02.360399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.360688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:02.360886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.361324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.362016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.362502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.362927 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.367004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.367482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.367912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.368593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.369039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.369455 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.549080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:02.555522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:02.556883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-42521f4e-e65e-47b1-bc73-6e1d94c3ff86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.207628 Oct 23 20:06:02.557475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 70/144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:02 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:02.563528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:02.565084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:02.566167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-52bd56e5-4d57-45e2-b996-8317d6869833 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.210087 Oct 23 20:06:02.566773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 75/145] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:02 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:02.692894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:02.693575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:02.699709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.700201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.700627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.701315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:02.701769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:02.702227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:02.806442 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:02.832160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:02.840222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6c3323eb-345f-4239-b955-3a6a11bbc6ad tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.151247 Oct 23 20:06:02.840785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 71/146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:02 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:03.014957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:03.015604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:03.021503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.021980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.022929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:03.023588 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.024034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.024449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:03.149109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:03.157739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-23a49223-6c48-4b0f-939d-9827388a44c0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.146533 Oct 23 20:06:03.158330 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:03 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:03.580924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:03.581528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:03.588652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.589150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.589583 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:03.590312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.591017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.591617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:03.593520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:03.594626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:03.596488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:03.605411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.606202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.606780 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:03.607833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:03.608240 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:03.610065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.201221 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.211176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-eef3dca9-4722-4d5e-9a59-6f9f2dc5482b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.633944 Oct 23 20:06:04.226641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 72/148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:03 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:04.232780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:04.233534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:04.239991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:04.240771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:04.241791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.242546 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:04.243000 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:04.243434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.255446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.266504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.268816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.269975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bed2e8cc-7c82-4128-a636-52a28f5fd765 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.681852 Oct 23 20:06:04.270902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 77/149] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:03 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:04.275562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:04.276324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:04.282420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:04.283084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:04.283642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.284516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:04.285103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:04.285652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.608648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.612343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:04.620233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8a2992f1-7a59-4cfd-904e-84df74bf33e8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.392428 Oct 23 20:06:04.621020 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7243687f-68eb-420b-845e-b1e61b4d62ea tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.348499 Oct 23 20:06:04.621702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 78/150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:04 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:04.622335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 73/151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:04 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:04.745264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:04.755007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:04.755484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:04.755906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:04.767833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] Creating event network-changed:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:06:04.773364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-868dc007-4f7d-46f9-baea-7500e9d9ec21 req-466756b1-3053-4c17-a1c8-012c70a345b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 Oct 23 20:06:04.774111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 79/152] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:05.245901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:05.246538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:05.252904 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.253390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.253819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.254545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.255017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.255418 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.299149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:05.299847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:05.306292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.306780 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.307211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.307896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.308365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.308782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.435459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.443148 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-40e02d6c-02d0-41df-8210-48368775cb8e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.207730 Oct 23 20:06:05.443722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 74/153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:05 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:05.465523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.473371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.474848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.476523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2710be69-836f-42f3-ace0-992aabc1111b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.181698 Oct 23 20:06:05.477069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 80/154] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:05 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:05.644707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:05.645315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:05.648504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:05.649357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:05.651982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.652457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.653063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.653752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.654203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.654644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.656089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.656621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.657287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.658133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:05.658828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:05.659439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:05.876435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.880100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:05.885676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5cb68562-4dc0-452e-906b-20c969d5387e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.244551 Oct 23 20:06:05.886297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 75/155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:05 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:05.903900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dbc30e9a-a05b-4d4b-9d9b-135cb1b2e81f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.262016 Oct 23 20:06:05.904488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 81/156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:05 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:06.466280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:06.466886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:06.472836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.473311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.473739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.474452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.474900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.475819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.500908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:06.501449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:06.507437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.507922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.508355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.509041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.509497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.509920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.652790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:06.661057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-62109b16-95b2-432b-a4f9-cda4b3cfcedf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.198571 Oct 23 20:06:06.674266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 76/157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:06 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:06.678031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:06.686066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:06.687547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:06.688647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c85d9887-18ac-4307-b3d4-bc87a2fdb920 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.191681 Oct 23 20:06:06.689201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 82/158] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:06 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:06.909043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:06.909662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:06.916156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.916645 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.917073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.917756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.918206 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.918656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.932917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:06.933689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:06.940284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.940995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.941434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:06.942132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:06.942611 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:06.943032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.155196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.164916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7dc694df-01d2-47f5-b9fe-e0fe703e73b6 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.259685 Oct 23 20:06:07.179343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.180231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 77/159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:06 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:07.187425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3d2e5b05-f9b0-460b-82ec-f38a77e0cf3e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.264041 Oct 23 20:06:07.188127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 83/160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:06 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:07.310070 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a8bceb-1edb-49db-9c3c-9c8de07e1b2a", "name": "network-vif-plugged", "status": "completed", "tag": "e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:07.319649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:07.320297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:07.320882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.331912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] Creating event network-vif-plugged:e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3 for instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a on hv-cinder-86243 Oct 23 20:06:07.337550 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-c3094a32-d94c-41be-90c4-215642056213 req-40d80fda-eabc-460e-bfb7-999fd3bc4df6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090165 Oct 23 20:06:07.338518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 78/161] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:07.684450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:07.684979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:07.690843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:07.691325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:07.691748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.692428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:07.692874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:07.693295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.713532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:07.714181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:07.720434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:07.720915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:07.721349 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.722159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:07.722645 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:07.723071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:07.871421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.879571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3fc455c3-0204-4b2c-bf82-d653b631c518 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.198391 Oct 23 20:06:07.880154 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:07 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:07.899380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.907372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.908822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:07.909910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9f036320-f8ee-4f4a-8e7f-a85fd7472726 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.200805 Oct 23 20:06:07.910490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 79/163] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:07 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:08.189739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:08.190370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:08.196448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.196922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.197347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.198024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.198497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.198917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.210793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:08.211430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:08.217320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.217795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.218222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.218922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.219369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.219782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.396032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:08.401907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:08.404451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-11621426-fe93-419c-aed2-d713d1b9780b tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.218292 Oct 23 20:06:08.405057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:08 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:08.413714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-65f9161f-ecff-49c3-98f0-cb840b2fbce9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.206450 Oct 23 20:06:08.414516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 80/165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:08 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:08.903447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:08.904056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:08.910053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.910569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.911016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.911686 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.912138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.912558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.934594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:08.935204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:08.940995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.941470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.941897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:08.942602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:08.943044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:08.943460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:09.096006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.105839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-57fe510f-35e5-4ea8-af85-414b0a86f85a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.206148 Oct 23 20:06:09.106451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 86/166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:08 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:09.119079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.127154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.128608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.129714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-38808d38-e494-4c96-9286-dc3629a0cc18 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.199179 Oct 23 20:06:09.130293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 81/167] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:08 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:09.427403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:09.428059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:09.434647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:09.435144 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:09.435685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:09.436394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:09.436849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:09.437268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:09.439503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:09.440138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:09.446484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:09.447051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:09.447514 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:09.448624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:09.449155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:09.449912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:09.642409 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.650845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-90d441ab-725e-47f9-84d4-87943a5ee5b2 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.227453 Oct 23 20:06:09.651807 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 87/168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:09 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:09.665111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:09.676401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-490f0530-d2b9-48cb-b0ad-d92d6317c744 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.241360 Oct 23 20:06:09.676964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 82/169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:09 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:10.128465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:10.129066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:10.135054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.135534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.135959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.136637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.137082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.137499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.154039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:10.154768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:10.160629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.161108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.161540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.162227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.163267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.163693 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.331273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.338894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.340753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f68bcc18-169a-4103-b0d5-3438d8dbe97b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.216043 Oct 23 20:06:10.341529 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 88/170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:10 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:10.347006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.348449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.349541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a4110167-e2cb-49b9-a1e4-cbc315ea5a1c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.199414 Oct 23 20:06:10.350152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 83/171] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:10 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:10.678915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:10.679747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:10.685675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.686153 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.686784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.687430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.687875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.688284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.701874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:10.702815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:10.708706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:10.714776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.715436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.716089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.717315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:10.718094 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:10.718725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:10.920020 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.929193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:10.929433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a86f63c1-5311-4887-aba4-a60f3e593f55 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.253875 Oct 23 20:06:10.939181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7ab97d6d-cfd2-4772-afca-b078a574c439 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.242200 Oct 23 20:06:10.946291 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 84/172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:10 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:10.946437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 89/173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:10 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:11.365779 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:11.367374 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:11.374610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:11.375193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:11.377533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.378027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.378483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.379547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.380411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.381018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.381162 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.381829 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.382457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.383285 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.383879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.384440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.659640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:11.669328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:11.671647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7198f624-220f-42bd-a13c-b274671bed88 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.310513 Oct 23 20:06:11.672598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 85/174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:11 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:11.685627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:11.685627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:11.685627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d45fcf80-fcf8-40cb-9a12-d22bb17785e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.311717 Oct 23 20:06:11.685995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 90/175] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:11 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:11.953371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:11.953973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:11.964486 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:11.965951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:11.968426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.968918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.969608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.970501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.971523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.974187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.978837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.979580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.980093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:11.980872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:11.981712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:11.983483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:12.196634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.205674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.213919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5ca0d830-f220-4290-a872-7326d644c6ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.253436 Oct 23 20:06:12.226426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 86/176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:11 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:12.228052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9913274a-f694-4c84-99eb-b8461f9a73af tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.279100 Oct 23 20:06:12.228904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 91/177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:11 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:12.697586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:12.698233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:12.712419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:12.713565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:12.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:12.714843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:12.715282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:12.715987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:12.716446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:12.717044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:12.727051 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:12.728164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:12.728956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:12.729977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:12.731224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:12.731956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:12.737453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:12.961715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.974907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0ae2452c-d593-44cf-9507-069df3df8637 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.279467 Oct 23 20:06:12.983286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.992236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 87/178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:12 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:12.994309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.995748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:12.997099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-19cadc3d-52e3-4b96-89b7-a113d4b11973 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.293352 Oct 23 20:06:13.007517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 92/179] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:12 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:13.242609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:13.242609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:13.248262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:13.248262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:13.248424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:13.248977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:13.249429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:13.249960 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:13.254221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:13.254921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:13.263556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:13.263932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:13.264793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:13.265704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:13.266222 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:13.266860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:13.506492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:13.507537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:13.514587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a2e69d87-6f99-4bd2-a92b-5ece6fd3a566 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.265152 Oct 23 20:06:13.515327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9e665db2-25ec-4cb1-a5f6-8758fa977e92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.278665 Oct 23 20:06:13.515441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 93/180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:13 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:13.518449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 88/181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:13 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:13.998991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:13.999596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:14.005412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.005897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.006887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.007583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.008038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.008494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.026457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:14.027414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:14.032911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.033391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.033826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.034543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.034995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.035416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.053598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:14.218914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.226268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.228756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b1cdd2e1-ce22-449b-bef6-6bb1428971e9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.233452 Oct 23 20:06:14.229954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 94/182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:13 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:14.241117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.242604 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.243932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cc1b34a2-d436-4e6c-82b5-261135337cd2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.222261 Oct 23 20:06:14.244476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 89/183] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:14 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:14.536865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:14.537475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:14.538521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:14.539343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=99 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:14.539547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:14.544702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.545189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.545586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.545685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.546128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.546319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.546621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.546773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.547193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.547326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:14.547804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:14.548240 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:14.735941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.738903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:14.744426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c8023ff9-ed69-45de-bcf6-6951ddd93b84 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.211489 Oct 23 20:06:14.745273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 95/184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:14 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:14.762641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d6e9b037-ac06-4ac4-b5bf-7a1988ee41ef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.228069 Oct 23 20:06:14.763273 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 90/185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:14 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:15.250959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:15.251565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:15.257853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.258387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.258815 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.259489 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.259930 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.260355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.268813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:15.269449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:15.275949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.276365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.276794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.277461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.277902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.278372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.450700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:15.457038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:15.464848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9fbbef05-e089-4ce9-8f46-dd929723a0de tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.217695 Oct 23 20:06:15.465124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:15.465426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 96/186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:15 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:15.466742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:15.467838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1c03cea2-3aa9-40e3-b5bf-43ced221751e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.202882 Oct 23 20:06:15.484085 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 91/187] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:15 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:15.769453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:15.770096 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:15.781145 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.784638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.784757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:15.785275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:15.785394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.787273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.788052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.788609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.801846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.802703 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.803830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:15.804767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:15.805368 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:15.805974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:16.245293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.253076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0ec31e98-c3a8-4d36-8751-cab1361e0cdd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.472286 Oct 23 20:06:16.253333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.254104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 92/188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:15 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:16.263146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b56f049f-2ca5-4364-bfd7-e0df426fe8e8 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.499899 Oct 23 20:06:16.263795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 97/189] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:15 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:16.488107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:16.488760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:16.495725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:16.496249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:16.496649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:16.497340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:16.497793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:16.498212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:16.505593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:16.506291 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:16.513010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:16.513687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:16.514104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:16.514907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:16.515426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:16.516014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:16.710883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.722447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3a176f4c-3e9d-43db-b7cc-2e2ad7674202 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.237881 Oct 23 20:06:16.735342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 93/190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:16 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:16.739905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.746652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.748093 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:16.749254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-aa7e657e-d27a-4c62-88a2-03ab9c126270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.247562 Oct 23 20:06:16.749721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 98/191] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:16 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:17.276759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:17.280858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:17.286375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:17.287054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:17.290163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.290990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.291903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.292732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.294183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.294697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.300419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.302202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.302927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.304966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.305939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.306768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.584128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:17.587743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:17.598815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7ee50c1e-0ef0-4faa-be1d-bae44f5d510a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.326747 Oct 23 20:06:17.599059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9a2add2d-cc6b-4f1c-b68a-92215edabe4c tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.317507 Oct 23 20:06:17.599918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 99/192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:17 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:17.600925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 94/193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:17 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:17.748462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:17.749322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:17.757470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.757973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.763800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.763800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.763800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.763800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.774624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:17.775506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:17.782731 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.783516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.784188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.784961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:17.785607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:17.786101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:17.971165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:17.981546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-87c2c42d-fb54-4bec-84fb-8249d3e8dc6b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.237480 Oct 23 20:06:17.982141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 100/194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:17 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:18.002904 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:18.010929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:18.012366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:18.013463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b1aafb7a-fa95-4f39-b859-860a691770b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.242690 Oct 23 20:06:18.014023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 95/195] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:17 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:18.620975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:18.622000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:18.622868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:18.623471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:18.628905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:18.629383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:18.629808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:18.630013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:18.630497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:18.630681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:18.630925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:18.631127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:18.631575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:18.631679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:18.632031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:18.632447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:18.840596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:18.845513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:18.854952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e063b633-8ee6-4310-8be1-e70b3a0541b1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.235686 Oct 23 20:06:18.855672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 96/196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:18 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:18.858565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eeebe886-6422-4a4c-8574-ff1869214545 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.241578 Oct 23 20:06:18.859948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 101/197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:18 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:19.003950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:19.004554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:19.012167 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.012167 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.012167 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.012502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.012925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.013337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.040394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:19.040394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:19.045724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.046195 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.046890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.047763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.048241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.048653 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.206790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:19.216338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ed72519a-5b59-4261-8e1d-787422d25257 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.216219 Oct 23 20:06:19.229539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 97/198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:18 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:19.229930 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:19.237962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:19.239448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:19.240595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ffba3a26-5891-4e02-9f93-dd13dda09100 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.206064 Oct 23 20:06:19.241152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 102/199] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:19 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:19.878668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:19.879284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:19.883261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:19.884741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:19.887219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.887940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.888402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.889436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.890079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.890711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.892165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.892656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.893090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:19.893785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:19.894578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:19.894997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.126464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.133390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.137253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1b44ac15-3a84-4e25-91e0-0de48c5d48e0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.258954 Oct 23 20:06:20.137827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 103/200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:19 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:20.142602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8837d8-442b-4b75-b896-e07e4a04391f", "name": "network-vif-plugged", "status": "completed", "tag": "2157f124-6d4c-4aa3-8b95-ee304dc9379e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:20.144347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-027a4b03-dd74-4f03-a612-293ca20db3b6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.271092 Oct 23 20:06:20.155315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:20.155901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:20.156177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 98/201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:19 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:20.156325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.168855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] Creating event network-vif-plugged:2157f124-6d4c-4aa3-8b95-ee304dc9379e for instance df8837d8-442b-4b75-b896-e07e4a04391f on hv-cinder-86243 Oct 23 20:06:20.173814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-a1e70908-441e-4b73-9813-ed66bfb4aeb6 req-f306caa2-59d3-415f-b259-f52ede5c5de9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034517 Oct 23 20:06:20.174412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 104/202] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:20.239541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:20.240261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:20.247069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:20.247604 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:20.248093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.248943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:20.249401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:20.249828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.268527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:20.269456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:20.275589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:20.276065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:20.276491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.277324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:20.277771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:20.278187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:20.460983 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.468023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.468825 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d5b220fb-bdb0-47e4-99db-bd4d93a819fb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.233166 Oct 23 20:06:20.469404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 99/203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:20 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:20.476596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.478026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:20.480539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-df3eb805-c1de-4dbb-9e48-ae8ba5f8791e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.217311 Oct 23 20:06:20.494418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 105/204] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:20 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:21.160156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:21.160759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:21.166797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:21.167220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.167336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.167425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:21.167695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.168372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.168832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.169239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.173127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.173607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.174034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.174742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.175250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.175671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.352709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.360028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.360559 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-274993c3-54f6-4d9c-b5fc-4cf0f2f99824 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.197547 Oct 23 20:06:21.361132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 106/205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:21 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:21.367660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a4b0d110-27cf-4cbf-abd8-9c3e127e1c4a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.211318 Oct 23 20:06:21.368212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 100/206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:21 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:21.491910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:21.492519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:21.498785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.499280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.499716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.500405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.501114 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.501539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.503577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:21.504543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:21.511294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.512322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.512767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.513456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:21.513905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:21.514520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:21.708360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.712896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.718075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-98addd0b-7309-4376-aac0-ea5c3c800cf3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.229825 Oct 23 20:06:21.718748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 107/207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:21 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:21.722349 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.724769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:21.726308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2aef9bd1-0654-4f63-a5c1-2b17b6a6a00d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.226557 Oct 23 20:06:21.727057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 101/208] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:21 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:22.382632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:22.383237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:22.389282 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.389768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.390200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.390434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:22.390905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.391156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:22.391355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.391772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.397837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.398337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.398763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.399437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.399887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.400304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.581204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.585247 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.589236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f70e6731-4e0a-41b0-bc2b-969017ae3935 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.210375 Oct 23 20:06:22.589806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 108/209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:22 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:22.596875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6a475936-4640-4622-a650-0f408f522953 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.210277 Oct 23 20:06:22.597444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 102/210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:22 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:22.741310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:22.741842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:22.747807 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.748284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.748710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.749395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.749844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.750281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.751917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:22.752512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:22.758201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.758702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.759127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.759798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:22.760253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:22.760666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:22.767996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:22.944457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.948773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.962045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0a1dc70c-6e38-4c13-9cb0-1afd7be620fe tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.224976 Oct 23 20:06:22.962889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.964412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:22.965523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-da5035de-5225-4bd6-af12-a4bf1166542d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.217396 Oct 23 20:06:22.966083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 103/211] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:22 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:22.966980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 109/212] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:22 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:23.611742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:23.612414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:23.619076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:23.620453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:23.620896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:23.621418 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:23.621800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:23.622023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:23.622474 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:23.622606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:23.629054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:23.629580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:23.630045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:23.630775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:23.631230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:23.631655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:23.817601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:23.821500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:23.827552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-892115f6-b7f4-43f2-a899-80cac426554a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.211944 Oct 23 20:06:23.828159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 104/213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:23 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:23.829602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1fed9585-88ba-43a6-be0b-5e0640874c41 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.221685 Oct 23 20:06:23.830172 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 110/214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:23 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:24.006685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:24.007042 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:24.007317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:24.007917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:24.014544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.015262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.016371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.017290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.018038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.018502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.024895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.025380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.025806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.026696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.027157 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.027573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.260809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:24.268292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:24.286061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4331a48c-00f0-4166-9550-0e9579945394 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.281606 Oct 23 20:06:24.288251 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 111/215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:24 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:24.288734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:24.290276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:24.291428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e1a1cce9-28fd-45bc-9061-a4f892278263 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.288628 Oct 23 20:06:24.292120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 105/216] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:24 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:24.850956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:24.851760 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:24.852037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:24.852651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:24.858826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.859047 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.859308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.859471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.859889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.860045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.860584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.861068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:24.861188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.861525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:24.861818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.861952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:24.866065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:25.061384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.069616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dfc4ea41-1b7f-447f-b877-141988e9c61d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.222812 Oct 23 20:06:25.072752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.080850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-608a34e2-d7b6-4b3a-86e6-4089850f97d2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.233087 Oct 23 20:06:25.081721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 106/217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:24 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:25.082596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 112/218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:24 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:25.311329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:25.312018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:25.320412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:25.320412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:25.320606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:25.320606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:25.320606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:25.321429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:25.321875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:25.322402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:25.325152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:25.325634 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:25.326058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:25.326970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:25.327426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:25.327849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:25.524860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.527674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.533023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.534740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:25.535267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5d07042f-10b3-402a-8bfb-72e24939db02 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.228093 Oct 23 20:06:25.535835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2a15b38f-ea9e-49ce-aa67-4d3ca801cf21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.222948 Oct 23 20:06:25.536168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 107/219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:25 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:25.548026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 113/220] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:25 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:26.092974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:26.094072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:26.100146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.100809 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.101397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.102225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.102845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.103262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.105440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:26.106057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:26.113212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.113919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.114376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.115082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.116025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.116598 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.306787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.309873 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.315473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f1df9b17-f2df-41f1-84bc-1b03bfb277a0 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.226182 Oct 23 20:06:26.316048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 108/221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:26 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:26.317430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6c214f99-3002-4966-9f8d-81ad76d1eb59 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.216812 Oct 23 20:06:26.317981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 114/222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:26 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:26.558684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:26.559284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:26.565173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.565660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.566079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.566816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.567265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.567680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.572691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:26.573558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:26.579949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.580731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.581380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.582622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:26.583145 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:26.583659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:26.765924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.777976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.778483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-00ef6dfe-f186-462a-a922-27ee068b7b8f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.223434 Oct 23 20:06:26.779071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 109/223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:26 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:26.793048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.794539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:26.795632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8db0ba71-9220-49aa-a05f-eb8af05e8590 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.227701 Oct 23 20:06:26.796187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 115/224] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:26 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:27.339410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:27.340336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:27.340770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:27.341075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:27.346548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.347039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.347474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.348168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.348410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.348618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.348890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.349039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.349315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.350026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.350493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.350910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.769756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:27.779364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-21eb7497-53a9-450a-b5b5-aca1a06d3f50 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.443716 Oct 23 20:06:27.780311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 110/225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:27 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:27.793261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:27.805280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7585bfce-f336-40a1-a4f3-a4413914eba7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.468785 Oct 23 20:06:27.806796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 116/226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:27 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:27.811915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:27.814229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:27.826044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:27.826963 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:27.835364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.836211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.836906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.837914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.838772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.839479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.840730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.841228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.841669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:27.842411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:27.847315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:27.847989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:28.197078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:28.201281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:28.205081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1adc766f-1030-4aeb-abfa-2714312ed6cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.400860 Oct 23 20:06:28.205650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 111/227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:27 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:28.211277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:28.212910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:28.214048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8ddf84a6-3f03-4ee5-88dc-a43fcbf47ceb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.397099 Oct 23 20:06:28.214791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 117/228] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:27 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:28.809042 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:28.809653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:28.816708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:28.817191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:28.817929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:28.819436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:28.820367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:28.821150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:28.835730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:28.836438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:28.842940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:28.843606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:28.844288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:28.845044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:28.845688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:28.846107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:29.030282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.037366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.039505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e3664172-1fc3-4ec8-8623-14f27844ae97 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.238937 Oct 23 20:06:29.040257 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 112/229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:28 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:29.045325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-30110523-3c88-40ca-833f-5c0155a6d21f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.215890 Oct 23 20:06:29.048724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 118/230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:28 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:29.228274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:29.228881 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:29.234899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:29.235383 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:29.235810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:29.236497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:29.236952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:29.237885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:29.241858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:29.243023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:29.250400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:29.251104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:29.251486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:29.252264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:29.252989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:29.254202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:29.431723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.440423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c77f06c5-c0b5-4771-a76e-12c94e322096 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.215909 Oct 23 20:06:29.441350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 113/231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:29 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:29.448128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.456409 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.457921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:29.459090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-72ea8387-620d-444e-9cf0-46df96e21d90 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.221902 Oct 23 20:06:29.459783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 119/232] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:29 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:30.062714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:30.063272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:30.067126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:30.067734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:30.070806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.071314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.071737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.072627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.073072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.073937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.074970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.075570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.076161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.077147 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.077740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.078334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.279239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.284744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.294537 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1590c59a-fcc2-4532-9da3-cdf789f4eb78 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.231628 Oct 23 20:06:30.295107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 120/233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:30 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:30.295560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5fc1681b-f530-494c-a022-d0e00375a8ee tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.236913 Oct 23 20:06:30.296166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 114/234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:30 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:30.464564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:30.465169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:30.470957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.471446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.471863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.472541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.472990 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.473407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.483450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:30.484053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:30.490201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.490914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.491499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.492182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:30.492750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:30.493322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:30.683691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.687702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.691735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3b3d16ce-bb43-4a34-a036-7aaef8cdbf25 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.230783 Oct 23 20:06:30.692190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 121/235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:30 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:30.697377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.698992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:30.700100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c80f2e11-445f-4d1b-bd0c-aea78bbcf859 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.220448 Oct 23 20:06:30.700894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 115/236] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:30 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:31.317950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:31.318986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:31.319607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:31.319687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:31.325246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.325449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.325703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.325959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.326126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.326416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.326893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.327101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.327339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.327546 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.327749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.327962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.514697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.521333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.522340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4b2b1dd2-830e-45b4-b99b-719992cfea8c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.207961 Oct 23 20:06:31.522913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 116/237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:31 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:31.529062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-aee932e3-c0f3-4dcd-8ced-b5d68a039ecc tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.215019 Oct 23 20:06:31.529619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 122/238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:31 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:31.714326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:31.714930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:31.720992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.721477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.721907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.722618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.723079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.723491 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.725194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:31.725781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:31.731629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.732100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.732524 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.733193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:31.733635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:31.734053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:31.911979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.916473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.920980 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-681e4414-2ad0-498c-9598-6997e7fd91e2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.210328 Oct 23 20:06:31.921803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 117/239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:31 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:31.925364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.926932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:31.928776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-55831fa6-7bc5-4e42-abf6-d76201fae411 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.207342 Oct 23 20:06:31.929719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 123/240] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:31 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:32.543917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:32.544552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:32.551144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.551537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.551967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.552256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:32.552694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.552871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:32.553128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.554205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.560111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.560956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.561396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.562320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.562762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.563177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.757431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:32.761785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:32.766187 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0b55eb5f-b1a8-4eb8-b3b8-cc05598eba37 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.226074 Oct 23 20:06:32.766818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 118/241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:32 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:32.771428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea876cfc-08f7-40c4-bcd8-2b1f32738f30", "name": "network-vif-plugged", "status": "completed", "tag": "41d3538a-ad99-4c35-a478-c0aa5c437554"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:32.780744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.781421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fb609296-3007-4dab-806e-2e135cbeeb7d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.233495 Oct 23 20:06:32.781581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.782150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.785193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 124/242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:32 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:32.796309 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] Creating event network-vif-plugged:41d3538a-ad99-4c35-a478-c0aa5c437554 for instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 on hv-cinder-86243 Oct 23 20:06:32.802106 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-7d623799-59fa-4b5f-b123-aa80aeb6c3d7 req-0ecfcdec-c419-48a7-b06e-ca7930e83069 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033935 Oct 23 20:06:32.802672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 119/243] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:32.945221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:32.945826 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:32.951942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.952417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.952897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.953572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.954015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.954464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.954561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:32.955256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:32.961848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.962389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.962823 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:32.963504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:32.963950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:32.964364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:33.141612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:33.150488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dbd5fa92-939a-42b7-ac8e-2af0e4d10abf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.209358 Oct 23 20:06:33.161220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 125/244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:32 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:33.168658 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:33.176673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:33.178155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:33.179270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-be6d1e56-86f3-416b-abdd-cd5ea32476d0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.229056 Oct 23 20:06:33.179827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 120/245] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:32 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:33.788939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:33.789704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:33.795650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:33.796129 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:33.796556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:33.797234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:33.797682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:33.798099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:33.802310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:33.805985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:33.806863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:33.813259 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:33.813751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:33.814190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:33.815002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:33.815463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:33.815889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:33.989163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:33.999554 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e8b6c119-4084-4295-9f48-428f8a08eeb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.214256 Oct 23 20:06:34.000336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 126/246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:33 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:34.001892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:34.022705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3056bbda-73ed-4599-9c04-217aff3a1e75 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.216216 Oct 23 20:06:34.023477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 121/247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:33 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:34.174168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:34.174704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:34.181919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:34.182611 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:34.183040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:34.183761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:34.184371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:34.184926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:34.205133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:34.206048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:34.212395 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:34.213146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:34.213646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:34.214442 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:34.215047 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:34.215464 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:34.371386 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:34.381275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-230cf373-c998-4a3e-b70c-6cc50e89e104 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.212109 Oct 23 20:06:34.381852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 127/248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:34 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:34.402392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:34.410491 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:34.411938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:34.413099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-74955c98-58f8-43d6-82ef-3364a0f85b58 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.212412 Oct 23 20:06:34.413651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 122/249] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:34 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:35.024710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:35.025825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:35.032423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.032908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.033334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.034026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.034502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.034920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.047405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:35.048004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:35.055095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.055721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.056216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.057009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.057726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.058267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.079548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:35.255318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.260665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.264442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9a0991cf-2e31-4d8b-8306-33aa0cb48609 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.245121 Oct 23 20:06:35.265457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 128/250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:35 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:35.269241 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3f83cb34-f4ad-475e-8a2b-be109d70868e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.226863 Oct 23 20:06:35.269850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 123/251] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:35 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:35.403550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:35.404509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:35.410915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.411395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.411817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.412556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.413003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.413418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.439465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:35.440063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:35.446949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.447603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.448177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.449001 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:35.449596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:35.450161 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:35.630479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.633130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.641623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cf2dc5d7-9014-4804-9f62-d84b51950bdd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.241831 Oct 23 20:06:35.642534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.646065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:35.647661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d2432923-7ef7-4f23-81a9-626740861467 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.212078 Oct 23 20:06:35.648343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 124/252] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:35 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:35.650534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 129/253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:35 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:36.295561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:36.296203 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:36.299393 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:36.300474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:36.308110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.308762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.309021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.309712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.310426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.311061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.311563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.312353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.312781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.314171 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.315717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.316341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.534925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.544121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-543de493-6764-4ac6-9400-f55f01a42ae5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.257657 Oct 23 20:06:36.544902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 125/254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:36 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:36.555372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.569015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d95d1b7b-d3c8-45e7-8efc-5463f5d77be7 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1315 microversion: 2.1 time: 0.279423 Oct 23 20:06:36.571369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 130/255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:36 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:36.664963 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:36.671012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:36.675065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:36.675925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:36.678523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.679040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.679528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.680254 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.680891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.681315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.683290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.683883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.684405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.685533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:36.686191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:36.686624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:36.881527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.889205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.890659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f25d12d5-0a2a-49e1-a825-ef4a6f9f9f7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.229496 Oct 23 20:06:36.891245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 126/256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:36 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:36.898987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.900670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:36.902046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ebf1b327-a308-492a-8175-53cef42efd8e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.232990 Oct 23 20:06:36.914723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 131/257] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:36 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:37.569460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:37.571167 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:37.580979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:37.581784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:37.582574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:37.583472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:37.584918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:37.585780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:37.596959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:37.598345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:37.606329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:37.607194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:37.607838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:37.608941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:37.610321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:37.610979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:38.182340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.189968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-09258595-72ec-4b71-9030-95c1fd99be8a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.624901 Oct 23 20:06:38.202549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 127/258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:37 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:38.207264 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:38.207860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:38.214453 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:38.214706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:38.215130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:38.215812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:38.216255 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:38.216668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:38.223853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.235172 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-23150537-11f9-4f46-a16e-71441a87ac5e tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1502 microversion: 2.1 time: 0.643126 Oct 23 20:06:38.240928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 132/259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:37 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:38.252980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:38.254752 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:38.268149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:38.268640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:38.269089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:38.269748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:38.270196 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:38.270638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:38.603056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.615624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.629847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.632852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-36881088-dc98-4801-beee-e258d45639a1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.390913 Oct 23 20:06:38.636667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 133/260] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:38 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:38.659940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:38.680132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0e892111-7743-4331-9c5a-dd811002a56a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.476428 Oct 23 20:06:38.698737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 128/261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:38 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:39.231031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:39.231825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:39.255668 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.256392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.258390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.265125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.266080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.266494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.576522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:39.587592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9ce4c987-5c1a-4237-bd4d-b80cde1e8917 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.365883 Oct 23 20:06:39.603080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 134/262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:39 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:39.660331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:39.661549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:39.667858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.668532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.669274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.670119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.670752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.671308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.707487 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:39.708107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:39.719915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.722576 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.723037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.723924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:39.724236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:39.726804 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:39.983943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:39.996176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:39.997619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:39.998770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-96c75038-587b-4405-9449-77b5f366c03f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.342448 Oct 23 20:06:39.999864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 129/263] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:39 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:40.078318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:40.089700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2cdc0c91-f0bc-4bfc-bdcc-748521e0b8a9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.386919 Oct 23 20:06:40.090214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 135/264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:39 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:40.614564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:40.615698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:40.632585 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:40.633158 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:40.634116 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:40.634932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:40.635477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:40.635969 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:40.851950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:40.862898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a7c17304-0edf-4472-bb01-2fdbefa1c1ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.254086 Oct 23 20:06:40.866220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 130/265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:40 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:41.025975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:41.026648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:41.036174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.038513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.039832 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:41.040996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.042562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.043378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:41.116232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:41.117145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:41.132676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=94 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:41.138791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.140019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.142154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:41.144164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.147164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.149367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:41.336392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:41.358544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:41.358544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:41.359266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5a6f5ea5-e9c9-44c2-864d-42e0bab229de tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.338283 Oct 23 20:06:41.359821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 136/266] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:41 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:41.405265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:41.422917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-00278794-649f-4bce-9dfb-94b702fdc0f2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.313422 Oct 23 20:06:41.423785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 131/267] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:41 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:41.889451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:41.890536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:41.900237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.900983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.901703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:41.903017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:41.903894 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:41.904589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:42.203608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:42.215024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6bd79b6a-d732-464d-a479-c7fa5712e8b2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1321 microversion: 2.1 time: 0.333421 Oct 23 20:06:42.234420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 137/268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:41 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:42.390623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:42.392230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:42.405598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:42.405598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:42.405598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:42.405598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:42.405893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:42.405893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:42.451010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:42.451667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:42.468311 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:42.475822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:42.476454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:42.480876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:42.482218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:42.485904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:42.729832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:42.741173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:42.746027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:42.747471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e04e288e-9eaf-4bb5-b8e0-a1d6df3c04e8 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.365878 Oct 23 20:06:42.762762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 132/269] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:42 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:42.816750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:42.828057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-04db2512-cad9-4187-a4f1-98913483ce97 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.381952 Oct 23 20:06:42.828639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 138/270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:42 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:43.138776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9432e303-9fcf-415f-9398-74346bd782fb"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:43.142708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:43.155756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.156725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.157340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.158230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.158783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.159312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.238868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:43.239487 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:43.254029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.255188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.256440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.259865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.260573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.262892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.491514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:43.500454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c4a7c358-3811-4780-a309-b5a87d0473d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1514 microversion: 2.1 time: 0.265719 Oct 23 20:06:43.515515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 139/271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:43 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:43.528578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:43.532100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:43.539517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.540354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.540914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.541715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.542412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.543050 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.638007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'flavor' on Instance uuid ea876cfc-08f7-40c4-bcd8-2b1f32738f30 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:06:43.800720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:43.821585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b1e771d8-d81a-41e2-ace8-0dda9d5f26cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30/action" status: 200 len: 32 microversion: 2.1 time: 0.299733 Oct 23 20:06:43.826519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 140/272] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:06:43 2022] POST /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 20:06:43.856793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:43.858592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:43.868362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.868857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.869293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:43.870001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:43.870476 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:43.871079 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:44.095550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:44.107869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:44.114844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:44.119039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2a2b7f3d-d474-4633-9286-872894e306bf tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.290961 Oct 23 20:06:44.119648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 141/273] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:43 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:44.127385 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:44.129045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:44.140105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:44.140626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:44.141139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:44.148900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:44.150844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:44.151900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:44.390324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:44.407069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a518b902-460b-49d3-8592-cdc257e33220 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.282369 Oct 23 20:06:44.408844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 142/274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:44 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:44.422467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:44.423795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:44.444080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:44.446357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:44.447483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:44.448544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:44.449579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:44.450500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:44.780613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:44.793173 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-842256d0-0097-44f3-886e-929f842b544b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.382345 Oct 23 20:06:44.794604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 143/275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:44 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:44.801556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3d6cd-5a81-425b-a929-808f46010e76", "name": "network-vif-plugged", "status": "completed", "tag": "e989a766-0552-40b5-acf0-9a2d7f1dfe99"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:44.829013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=98 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:44.834606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:44.835082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:44.835503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.029251 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] Creating event network-vif-plugged:e989a766-0552-40b5-acf0-9a2d7f1dfe99 for instance 80f3d6cd-5a81-425b-a929-808f46010e76 on hv-cinder-86243 Oct 23 20:06:45.037411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-6a13b849-5378-4c31-bd33-6e4bb3e7eb05 req-2cb156ff-0190-4bb5-bb02-56b5f030220d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240451 Oct 23 20:06:45.039122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 144/276] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:45.149299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:45.150292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:45.156715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.157495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.158104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.159161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.160111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.160776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.313336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:45.326673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:45.328984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:45.330438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e9e62760-a8a2-4451-9c4d-83fcad04997b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.186867 Oct 23 20:06:45.331373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 145/277] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:45 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:45.437051 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:45.437645 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:45.454852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.455647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.456296 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.457212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.457852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.458478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.661433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:45.675801 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-263940ec-55c0-4095-a7b3-90a5e0754778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.240380 Oct 23 20:06:45.678614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 146/278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:45 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:45.824824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:45.825985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:45.839908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.841898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.842373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:45.844133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:45.844591 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:45.846226 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:46.138042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:46.154798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-831faf3f-429a-45ca-9622-9031bf2fd0c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.336162 Oct 23 20:06:46.155975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 147/279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:45 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:46.365579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:46.366972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:46.382024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:46.383186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:46.385968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:46.388029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:46.388671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:46.390836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:46.644169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:46.661967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:46.679215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:46.680768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8d01df97-253a-4771-bed1-a301e80d930f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.328407 Oct 23 20:06:46.685073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 148/280] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:46 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:46.703776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:46.720339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:46.729628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:46.731912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:46.732349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:46.733056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:46.733510 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:46.733918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:47.211744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3523bf4f-d5d8-40e3-a755-fd355345052d tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "POST /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.060279 Oct 23 20:06:47.222685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 133/281] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:06:43 2022] POST /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a/os-volume_attachments => generated 194 bytes in 4089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:47.248577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:47.250860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:47.274851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:47.275450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:47.279909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:47.282941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:47.283439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:47.283925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:47.323141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:47.339188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-40c7dab5-729c-4dd1-954e-a0445ece462c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.642474 Oct 23 20:06:47.339772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 149/282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:46 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:47.712876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:47.713499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:47.734709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:47.735216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:47.735644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:47.736364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:47.736815 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:47.737232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:47.989740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:48.017108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6cb76c83-48fb-4af4-8eb5-2dc0b37a25a2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 0.790227 Oct 23 20:06:48.017762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 134/283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:47 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:48.134616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:48.152104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:48.153833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:48.159081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0580b73f-6832-4a0b-b06b-8f066fc79b5b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.450664 Oct 23 20:06:48.159924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 150/284] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:47 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:48.370426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:48.372073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:48.387845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:48.388345 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:48.390263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:48.391199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:48.391941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:48.393422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:48.721426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:48.730168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-20f7e5f6-be03-4288-977c-023db3df6f35 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.364846 Oct 23 20:06:48.731260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 135/285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:48 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:49.041528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:49.042217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:49.051438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:49.057859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:49.058703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:49.059453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:49.061786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:49.063867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:49.198721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:49.199423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:49.222836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:49.225524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:49.226020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:49.227594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:49.229203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:49.231446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:50.224492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:50.239273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8a0775fd-0cb1-472b-a0da-15b006e58416 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1362 microversion: 2.1 time: 1.201255 Oct 23 20:06:50.245122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 151/286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:49 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1362 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:50.258323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:50.258947 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:50.268445 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:50.270713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:50.272152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:50.281133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:50.286070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:50.286457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:50.286945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:50.296499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:50.298213 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:50.299370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bc737e9d-68da-4429-91cb-048b73c59a12 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 1.115551 Oct 23 20:06:50.303560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 136/287] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:49 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:50.662232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:50.673292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-20d420a1-2eee-47d6-8487-43be59142740 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.426910 Oct 23 20:06:50.676395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 152/288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:50 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:51.270382 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:51.272128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:51.283763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:51.285055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:51.286912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:51.287861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:51.290725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:51.293871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:51.333389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:51.334827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:51.371811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:51.373055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:51.377447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:51.382415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:51.383013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:51.385750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.034137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:52.045031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dec765a8-d226-4d93-a5a8-b2952cd32ee9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1548 microversion: 2.1 time: 0.780440 Oct 23 20:06:52.046486 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 137/289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:51 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1548 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:52.051738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:52.052637 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:52.060169 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:52.060906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:52.071920 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.073033 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:52.075761 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:52.080307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.087928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:52.122838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:52.124823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:52.126271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-38d33bbb-2ce5-4ecf-a00b-fd2f4daf4e55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.798521 Oct 23 20:06:52.136646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 153/290] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:51 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:06:52.152742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "name": "network-vif-plugged", "status": "completed", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:52.170123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:52.170745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:52.171246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.185322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] Creating event network-vif-plugged:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:06:52.191548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-11181ccc-f086-4e07-a70f-97eb5c0a19a2 req-6ad30a55-30c9-49ed-b96d-0e8c46c0bfd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051458 Oct 23 20:06:52.192516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 154/291] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:52.201197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:52.202062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:52.210478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:52.211271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:52.211924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.213167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:52.213851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:52.214518 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:52.420840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3408f30f-7a60-4380-87c1-08254114046d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225267 Oct 23 20:06:52.421465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 155/292] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:06:52 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:52.577461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:52.582139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:52.595573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-381342c7-da2b-4a45-9761-e5b0e01a3b1c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.547541 Oct 23 20:06:52.596626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 138/293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:52 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:53.161334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:53.162424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:53.185187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:53.191277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:53.191734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:53.195333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:53.198828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:53.199335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:53.621141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:53.621765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:53.628751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:53.629235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:53.637016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:53.637960 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:53.640794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:53.642187 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:54.334294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:54.359559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5868b25f-a246-41d2-a84a-b2d89369d900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.741948 Oct 23 20:06:54.366444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 139/294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:53 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:54.452139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:54.463709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:54.466843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:54.469342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-990a7b24-8d64-4e73-bbc5-9c00627440d1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 1.319050 Oct 23 20:06:54.472689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 156/295] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:53 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:54.916478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3d6cd-5a81-425b-a929-808f46010e76", "tag": "e989a766-0552-40b5-acf0-9a2d7f1dfe99"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:54.936816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:54.937428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:54.937961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:54.956287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] Creating event network-changed:e989a766-0552-40b5-acf0-9a2d7f1dfe99 for instance 80f3d6cd-5a81-425b-a929-808f46010e76 on hv-cinder-86243 Oct 23 20:06:54.963761 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-fbab9b02-5917-49ff-8a92-5b592f83ee16 req-e01f7726-a0f8-47aa-8f98-6b46ee0999e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053067 Oct 23 20:06:54.965372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 140/296] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:06:55.396045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:55.397128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:55.408107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:55.408914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:55.409666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:55.410563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:55.411345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:55.412009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:55.510763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:55.511497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:55.531554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:55.538883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:55.542386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:55.543320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:55.545096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:55.545702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:55.830765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:55.845094 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-31ff4485-ea81-4a7a-9689-1a60e6c7d39a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.454088 Oct 23 20:06:55.847762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 157/297] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:55 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:55.864274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1922110769", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "networks": [{"uuid": "bc4941ab-4461-4d24-b235-1a82a516c52f"}]}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:06:55.987456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:55.996776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:55.998234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:56.000137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c6691750-10f2-4a9b-8c3b-d405cc4b1c55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1407 microversion: 2.20 time: 0.496970 Oct 23 20:06:56.003112 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 141/298] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:55 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:56.044260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] validate_networks() for [('bc4941ab-4461-4d24-b235-1a82a516c52f', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:06:56.805475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:06:56.807951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:06:56.808514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:06:56.808938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:06:56.809496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:06:56.824246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:56.826537 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:56.828871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:56.829666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:56.831650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:56.834770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:56.876274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Getting quotas for project 46b77aad0457485693b9a43b85506915. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:06:56.877814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:56.878470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:56.888290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:56.888790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:56.889228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:56.889973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:56.890507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:56.890927 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:56.892741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Getting quotas for user 48be37e3311a4d6c968b135f8e5ee536 and project 46b77aad0457485693b9a43b85506915. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:06:56.922231 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:06:56.926276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:06:57.108023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-13ffd420-962b-4120-baf9-e43958c0e24d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257447 Oct 23 20:06:57.111157 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 158/299] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:06:57.124122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:57.132186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:57.151813 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.152307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.152739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.153436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.153885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.170183 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.429535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:57.438400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f87f18b3-6a46-4662-825d-085ed5ab223a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.566628 Oct 23 20:06:57.455587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 142/300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:56 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:57.477447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-307b5be8-8fe0-44f4-9b95-09b15f9523b6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:57.478237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-307b5be8-8fe0-44f4-9b95-09b15f9523b6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:57.679561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-307b5be8-8fe0-44f4-9b95-09b15f9523b6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:57.688913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-307b5be8-8fe0-44f4-9b95-09b15f9523b6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1214 microversion: 2.1 time: 0.229867 Oct 23 20:06:57.690997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 143/301] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:57 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:57.798949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:57.811244 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:57.825031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:57.825798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:57.826054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:57.828191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:57.829713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9aacba3b-bbfd-44c5-91ba-ea7d485e7270 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1599 microversion: 2.20 time: 0.717388 Oct 23 20:06:57.830694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 159/302] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:06:57 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1599 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:06:57.833320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.838802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.839342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.840139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.840739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.841188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.870599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:57.871932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:57.883710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.884988 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.885840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.886738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:57.887346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:57.887953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:57.914501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:06:58.008570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1a397d63-23c2-4572-9bf2-bd80f3b8b2e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145356 Oct 23 20:06:58.010654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 160/303] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 23 20:06:57 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 20:06:58.116557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dad028fe-d93f-418f-b8a9-dc2db9c90215 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 204 len: 0 microversion: 2.1 time: 0.296158 Oct 23 20:06:58.120978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 144/304] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:06:57 2022] DELETE /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:06:58.128119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:58.129755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:58.145665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.146914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.148783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:58.152289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.152980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.153496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:58.478226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:58.479936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:58.497746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.498389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.499061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:58.499989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.500668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.501299 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:58.831124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:58.851236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-685c8414-89c0-43e2-9f3b-4c21bb1d08df tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1554 microversion: 2.1 time: 0.729084 Oct 23 20:06:58.867176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 161/305] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:58 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1554 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:58.873657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:58.874952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:58.881824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.882571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.884055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:58.885312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:58.886448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:58.887064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:59.251182 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:59.258879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d782ed36-f69e-41ed-abc8-6d9e723a9281 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1218 microversion: 2.1 time: 0.390250 Oct 23 20:06:59.276983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 162/306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:58 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1218 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:06:59.368618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:06:59.391090 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4d250e57-89f2-439c-83af-84a58b85c879 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.917658 Oct 23 20:06:59.402529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 145/307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:58 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:06:59.876860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:06:59.878167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:06:59.892237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:59.892728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:59.893338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:06:59.898517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:06:59.904493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:06:59.904937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:00.258055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:00.286335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c2d6476c-ce79-49b7-b053-d53540756d18 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1554 microversion: 2.1 time: 0.413099 Oct 23 20:07:00.287307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 163/308] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:06:59 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1554 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:00.289412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:00.290847 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:00.302102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:00.303003 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:00.304364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:00.305893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:00.307181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:00.310545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:00.431885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:00.440443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:00.478083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:00.482315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:00.484142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:00.487900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:00.490442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:00.493459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:00.534968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:00.551163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f4ba3c91-c4c0-42dd-a423-7a17a4ad1970 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1266 microversion: 2.1 time: 0.267102 Oct 23 20:07:00.553151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 146/309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:00 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:00.973587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:00.988523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5b2ab43f-a343-419f-9a17-8322ecd26aed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.559844 Oct 23 20:07:01.010183 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 164/310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:00 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:01.049699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:01.110171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:01.113650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:01.116656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:01.155684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] Creating event network-changed:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:07:01.165894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-170eb175-9669-48bd-a8ec-fdf7e9bf968c req-3daf59f1-b623-4718-ae13-90ca3dfc89c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129717 Oct 23 20:07:01.167633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 147/311] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:01.311170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:01.312321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:01.329091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:01.331157 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:01.334299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:01.336953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:01.338724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:01.341205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:01.588432 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:01.592551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:01.612866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:01.613344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:01.614041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:01.616077 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:01.616605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:01.617037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:01.748905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:01.777134 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8e6e5d7d-1797-4d22-a168-a916758cc33e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1272 microversion: 2.1 time: 0.202231 Oct 23 20:07:01.778046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 148/312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:01 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:01.976520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:01.989328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-31a3182b-7051-49f8-bb02-3cfc63fa4bca tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1554 microversion: 2.1 time: 0.684063 Oct 23 20:07:01.990734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 165/313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:01 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1554 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:02.031451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:02.033780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:02.044020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:02.046854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:02.047377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:02.051656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:02.053113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:02.053636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:02.459263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:02.472275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1b3ea688-d4c8-4f9e-94ff-dce9018d8126 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.455300 Oct 23 20:07:02.478807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 149/314] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:02 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:02.694855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a8bceb-1edb-49db-9c3c-9c8de07e1b2a", "name": "network-vif-deleted", "tag": "e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:02.742614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:02.742727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:02.747100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:02.790396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] Creating event network-vif-deleted:e11e9e71-cd4a-4f28-bb41-95dbeea5bbf3 for instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a on hv-cinder-86243 Oct 23 20:07:02.807574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:02.808882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:02.817320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-672023c8-ab38-43d8-88f3-236f05539816 req-ffe2ee8c-a7e0-4a28-a704-a17803b0f35d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124260 Oct 23 20:07:02.822899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 166/315] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:02.827223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:02.828745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:02.834675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:02.835607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:02.836851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:02.837551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:03.018770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:03.019583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:03.030196 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:03.030716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:03.045781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:03.050473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:03.058984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:03.062866 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:03.295331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:03.305684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-522ba405-ab4d-4f5c-b4b3-3951820c1d10 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1272 microversion: 2.1 time: 0.502078 Oct 23 20:07:03.308010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 150/316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:02 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1272 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:03.335127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a571b802668942e2b612ef125fe34ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03c05196b64299bf41b7d4c412070a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:03.347884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a7e1c4c5-5fa5-4b79-9494-da89fd719161 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 200 len: 1346 microversion: 2.1 time: 0.336223 Oct 23 20:07:03.350020 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 167/317] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:03 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 1346 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:03.500013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:03.500628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:03.508816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:03.515894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:03.516555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:03.517448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:03.518063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:03.518724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:03.718287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:03.734134 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-94b58c15-0d6c-422a-ab21-cbc1d56ed612 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.238188 Oct 23 20:07:03.735081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 151/318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:03 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:04.336372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:04.337682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:04.348530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.351969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.352574 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.357248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.357928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.359236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.375784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:04.382595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:04.393721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.395564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.398017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.399313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.402937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.403648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.436982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] HTTP exception thrown: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Request method failure captured: Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a HTTP/1.1 Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ59RdSp2kjk_syndA3SbPIcIyzdXmUeKlOLn07Cjj7ElF028QCXl-VzpNjMayOk2IgYzEccwmFhiKsdP3Nhk6Bs66n48Lhno8CmtB53E53KXd-SbAfdom0ZKSyAtPrtxFDGtTdXH-q5caBRGOXYdgws_hYSoTWtIa52oQg3gA6OvgI Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:07:04.441975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd03c05196b64299bf41b7d4c412070a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}] Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: a571b802668942e2b612ef125fe34ea6 Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.443618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '50a8bceb-1edb-49db-9c3c-9c8de07e1b2a'} Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:07:04.444741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.446893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.454388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Returning 404 to user: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:07:04.459629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e8858bfe-8447-42f9-890f-e2682fdc9292 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 404 len: 111 microversion: 2.1 time: 0.090366 Oct 23 20:07:04.460586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 152/319] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:04 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:04.601730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:04.617584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a43ca452-ab15-47cd-a0de-a5451fffb437 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.285294 Oct 23 20:07:04.620542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 168/320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:04 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:04.692168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:04.695389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:04.704525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.705502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.706118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.707006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.707631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.708744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.731022 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] HTTP exception thrown: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Request method failure captured: Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a/os-volume_attachments HTTP/1.1 Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ59RdSp2kjk_syndA3SbPIcIyzdXmUeKlOLn07Cjj7ElF028QCXl-VzpNjMayOk2IgYzEccwmFhiKsdP3Nhk6Bs66n48Lhno8CmtB53E53KXd-SbAfdom0ZKSyAtPrtxFDGtTdXH-q5caBRGOXYdgws_hYSoTWtIa52oQg3gA6OvgI Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:07:04.733128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd03c05196b64299bf41b7d4c412070a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}] Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: a571b802668942e2b612ef125fe34ea6 Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.734326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'server_id': '50a8bceb-1edb-49db-9c3c-9c8de07e1b2a'} Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:07:04.734997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:04.736027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:07:04.738662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Returning 404 to user: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:07:04.739926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-66a440b8-d4e5-4b4c-a0e1-9d47ae95a17a tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052065 Oct 23 20:07:04.744324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 153/321] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:07:04 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:04.765148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:04.769790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:04.777201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.777991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.778670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:04.779949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:04.780639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:04.781242 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:05.044158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:05.052625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-672a3889-e488-4b3f-a176-a9b08fc6df18 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.295567 Oct 23 20:07:05.057232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 169/322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:04 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:05.379062 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a4bbdc-fae2-4779-a550-4f9c21b29226", "tag": "85c41c4a-1d7d-4750-b70c-de441e07d178"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:05.412704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:05.414551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:05.415915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:05.430613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] Creating event network-changed:85c41c4a-1d7d-4750-b70c-de441e07d178 for instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 on hv-cinder-86243 Oct 23 20:07:05.440742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-fb9ee14e-e9fd-4b11-b232-6f125804ea0b req-47611ea3-b964-44e2-afd1-e1ec80eff4a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066383 Oct 23 20:07:05.444239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 154/323] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:05.644225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:05.645645 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:05.668991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:05.670042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:05.671131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:05.672318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:05.673462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:05.674409 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:05.930442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:05.947279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7e6906a9-4f20-4aad-a7bc-6a1355d56a1c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.308276 Oct 23 20:07:05.948046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 170/324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:05 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:06.077664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:06.078569 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:06.086377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.087750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.088484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.089889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.090662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.092011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.191884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:06.192747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:06.204636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.206222 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.207145 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.208743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.209862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.210742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.251743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] HTTP exception thrown: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Request method failure captured: Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a HTTP/1.1 Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ59RdSp2kjk_syndA3SbPIcIyzdXmUeKlOLn07Cjj7ElF028QCXl-VzpNjMayOk2IgYzEccwmFhiKsdP3Nhk6Bs66n48Lhno8CmtB53E53KXd-SbAfdom0ZKSyAtPrtxFDGtTdXH-q5caBRGOXYdgws_hYSoTWtIa52oQg3gA6OvgI Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:07:06.267626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd03c05196b64299bf41b7d4c412070a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}] Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: a571b802668942e2b612ef125fe34ea6 Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.268842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '50a8bceb-1edb-49db-9c3c-9c8de07e1b2a'} Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:07:06.269490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.270712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.273788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Returning 404 to user: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:07:06.274899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b6319128-ce53-4668-ac23-bafa7ca8e0c3 tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 404 len: 111 microversion: 2.1 time: 0.087286 Oct 23 20:07:06.276418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 171/325] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:07:06 2022] DELETE /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:06.289316 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:06.290189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] [instance: 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:06.298825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.299637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.300297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.301227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.302118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:06.302989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:06.332368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] HTTP exception thrown: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Request method failure captured: Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a HTTP/1.1 Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ59RdSp2kjk_syndA3SbPIcIyzdXmUeKlOLn07Cjj7ElF028QCXl-VzpNjMayOk2IgYzEccwmFhiKsdP3Nhk6Bs66n48Lhno8CmtB53E53KXd-SbAfdom0ZKSyAtPrtxFDGtTdXH-q5caBRGOXYdgws_hYSoTWtIa52oQg3gA6OvgI Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:07:06.334876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd03c05196b64299bf41b7d4c412070a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd03c05196b64299bf41b7d4c412070a"}]}] Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: dd03c05196b64299bf41b7d4c412070a Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-DeleteServersTestJSON-2142911707 Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: a571b802668942e2b612ef125fe34ea6 Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-DeleteServersTestJSON-2142911707-project Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.336032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '50a8bceb-1edb-49db-9c3c-9c8de07e1b2a'} Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:07:06.336711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. Oct 23 20:07:06.337848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:07:06.340818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] Returning 404 to user: Instance 50a8bceb-1edb-49db-9c3c-9c8de07e1b2a could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:07:06.342033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bbb9d717-097a-4b3f-a946-789fa495bbbf tempest-DeleteServersTestJSON-2142911707 tempest-DeleteServersTestJSON-2142911707-project] 10.222.0.13 "GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a" status: 404 len: 111 microversion: 2.1 time: 0.059708 Oct 23 20:07:06.343006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 172/326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:06 2022] GET /compute/v2.1/servers/50a8bceb-1edb-49db-9c3c-9c8de07e1b2a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:06.354800 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:06.367025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-52533941-5004-470a-8595-bb73ec496bb8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.292667 Oct 23 20:07:06.369829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 155/327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:06 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:06.973447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:06.973904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:06.991272 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:06.992105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:06.998417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:06.998929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:07.002867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:07.005869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:07.006429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:07.006889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:07.216650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:07.231947 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1d5f44df-06db-4d63-8840-31c7ca626991 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.263664 Oct 23 20:07:07.235998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 173/328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:06 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:07.398124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:07.399953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:07.416304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:07.417319 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:07.418003 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:07.418755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:07.419404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:07.420024 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:07.627682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:07.636184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-427f0e4e-bf7b-428d-abcb-09958e6e7ec2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.242875 Oct 23 20:07:07.638581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 156/329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:07 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:08.257600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:08.258174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:08.267309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:08.267913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:08.268442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:08.271399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:08.272034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:08.276104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:08.508447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:08.517817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1b931171-f433-4d06-a08a-78daf21c07ca tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.264823 Oct 23 20:07:08.518982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 174/330] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:08 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:08.657921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:08.665745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:08.666730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:08.673480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:08.674480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:08.675156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:08.676196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:08.676861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:08.677574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:08.961718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:09.004867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d8488bb5-c7f8-4a94-84d9-296b01344c1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.347436 Oct 23 20:07:09.011181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 157/331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:08 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:09.541647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:09.542227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:09.553610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:09.554387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:09.557263 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:09.558198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:09.559089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:09.560348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:09.895411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:09.914422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d57eb125-2583-41ed-8caa-bc13860ddca0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.376331 Oct 23 20:07:09.917080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 175/332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:09 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:10.078717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:10.080266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:10.087590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:10.088458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:10.089155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:10.090110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:10.090831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:10.091477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:10.162671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:10.315435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:10.325282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4d3390d2-9f5b-48c1-a1ad-0dcde5b65cfd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.250724 Oct 23 20:07:10.338584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 158/333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:10 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:10.936895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:10.938143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:10.948108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:10.948558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:10.954495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:10.955597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:10.956270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:10.956920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:11.225721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:11.236334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5c8feff8-c8b0-4238-9749-6d3da507c620 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.303254 Oct 23 20:07:11.237787 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 176/334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:10 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:11.352283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:11.353584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:11.356159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:11.364182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:11.371575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:11.372556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:11.373592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:11.374287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:11.374937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:11.585863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:11.595763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7f64495c-2bb5-4885-8c7b-531231480c47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.247364 Oct 23 20:07:11.596306 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 159/335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:11 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:12.261402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:12.261998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:12.267727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:12.268458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:12.269112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:12.270023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:12.270729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:12.271330 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:12.421347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:12.430006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4bc7d800-7d2e-43ec-b890-01982d6cb8ed tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.172279 Oct 23 20:07:12.438237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 177/336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:12 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:12.630523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:12.631150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:12.637737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:12.638229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:12.638704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:12.639410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:12.639870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:12.640295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:12.769447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-950432ca-2341-4a96-9903-484abd23df98 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'create', calling method: .version_select at 0x7f64f1031c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2077887482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKryL/Q18oM7n1grfbvo79wY71ZIOxZ0biFsvXWnFC7/xmS1hUNWlOrX+NywVkBEPHDYH6H6eAvwFVpj1DKWpQTH3dcRioxV1xACyYCFYuoAhOOLW0RmBb02aSX+TN+HRw=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:12.787037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-950432ca-2341-4a96-9903-484abd23df98 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Getting quotas for project 6b4261a7b9e642e5ba063a4790296b66. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:07:12.793187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-950432ca-2341-4a96-9903-484abd23df98 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Getting quotas for user 7d0a9c2670794fb4b134e261411fd9cb and project 6b4261a7b9e642e5ba063a4790296b66. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:07:12.811764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:12.824170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-950432ca-2341-4a96-9903-484abd23df98 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058801 Oct 23 20:07:12.824916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 178/337] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:07:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:12.835411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5fd438bd-8685-45a7-b3e6-f58cc60a99a5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.216668 Oct 23 20:07:12.836038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 160/338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:12 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:12.940527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1090656324", "imageRef": "5d985e05-5018-4314-9cd8-8afda03d3e2b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2077887482", "networks": [{"uuid": "e0f910e3-91d1-4d9b-b720-07380b5a7ead"}]}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:13.009223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] validate_networks() for [('e0f910e3-91d1-4d9b-b720-07380b5a7ead', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:07:13.399021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:07:13.399578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:07:13.400055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:07:13.400455 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:07:13.400852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:07:13.409443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.410046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.410505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.411265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.411708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.412120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.423741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:13.431009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Getting quotas for project 6b4261a7b9e642e5ba063a4790296b66. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:07:13.438724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Getting quotas for user 7d0a9c2670794fb4b134e261411fd9cb and project 6b4261a7b9e642e5ba063a4790296b66. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:07:13.451495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:07:13.453808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d985e05-5018-4314-9cd8-8afda03d3e2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:07:13.456039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:13.456805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:13.463705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.464267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.464794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.465546 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.465950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.466450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.512473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2b7a3fd8-922f-49aa-9be2-35a38d391e4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576147 Oct 23 20:07:13.514401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 179/339] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:07:13.530395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1cf05866-b80c-43bc-9bbd-5ea7a69d04b2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:13.530395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1cf05866-b80c-43bc-9bbd-5ea7a69d04b2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:13.598507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1cf05866-b80c-43bc-9bbd-5ea7a69d04b2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:13.607164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1cf05866-b80c-43bc-9bbd-5ea7a69d04b2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1259 microversion: 2.1 time: 0.087022 Oct 23 20:07:13.610625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 180/340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:13 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1259 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:13.667027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:13.675146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8b7e0ada-f573-4816-bf16-1f0c4fb93264 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.223925 Oct 23 20:07:13.675784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 161/341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:13 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:13.858658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:13.859247 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:13.867691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.868205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.868660 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.869392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:13.869838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:13.870268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:13.904308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:14.033439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:14.041731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a0525630-2a4e-4ce7-baf1-2872e3d51794 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.187077 Oct 23 20:07:14.044891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 181/342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:13 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:14.629680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:14.630327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:14.636384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:14.636899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:14.637330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:14.638050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:14.638529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:14.638955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:14.698853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:14.700149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:14.700756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:14.707854 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:14.708418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:14.708536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-99f48f83-fc01-4419-ab03-290b87b020af tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1263 microversion: 2.1 time: 0.082817 Oct 23 20:07:14.708931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:14.709072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 162/343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:14 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:14.718404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:14.718404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:14.718404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:14.862508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:14.870333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b386acc9-375c-478c-bb64-964c5c0bfad9 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.174600 Oct 23 20:07:14.870909 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 182/344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:14 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:15.066939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:15.067628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:15.074433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.074986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.075427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:15.076153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.076612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.077039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:15.275625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:15.284434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c47aa6f1-ea41-4b75-a591-164be0a77da0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.221493 Oct 23 20:07:15.285646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 163/345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:15 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:15.738594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:15.738594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:15.742029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.742550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.743118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:15.744124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.744786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.745423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:15.824685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:15.835941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ab3dbb32-87ba-415b-92d6-cfa14f9f5ce1 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1311 microversion: 2.1 time: 0.107286 Oct 23 20:07:15.836511 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 183/346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:15 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:15.900676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:15.902682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:15.911220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.912308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.912902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:15.913607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:15.914051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:15.914831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:16.101606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:16.110925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-eb0ec0a8-89b8-4272-9a3b-2a1360ac4e99 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.220770 Oct 23 20:07:16.111612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 164/347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:15 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:16.309036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:16.309641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:16.315525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:16.316006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:16.316443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:16.317135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:16.317589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:16.318179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:16.468049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:16.478198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-11e47d67-9c7f-4651-8877-9034536028c5 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.172850 Oct 23 20:07:16.479223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 184/348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:16 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:16.859366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:16.860079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:16.866972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:16.867541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:16.868103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:16.869582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:16.870219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:16.870828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:16.991712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:17.014561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b2eed692-e7cf-4366-89bd-cebf7226b20c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1317 microversion: 2.1 time: 0.157638 Oct 23 20:07:17.038428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 165/349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:16 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:17.136257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:17.137718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:17.157211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:17.159134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:17.159610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:17.161508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:17.164528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:17.165089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:17.492097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:17.502467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:17.503089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:17.509113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9d991bad-d0c8-403d-b6bc-b5efe0b6b4ab tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.371750 Oct 23 20:07:17.526289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 185/350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:17 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:17.526494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:17.526494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:17.526494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:17.529014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:17.529622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:17.530184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:17.847041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:17.860154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9b5c28c8-1867-460a-821d-ff2275ceb1cd tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.361696 Oct 23 20:07:17.860875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 166/351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:17 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:18.042664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:18.043911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:18.065004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.065749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.066458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:18.067446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.069721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.070394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:18.361347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:18.371257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7b156c2c-7b25-4c71-9baf-94e17cea8ff8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.334028 Oct 23 20:07:18.378379 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 186/352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:18 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:18.545427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:18.547030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:18.575817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.576633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.577225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:18.578100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.578730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.579311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:18.825916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:18.840754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9cd7a89a-1e8f-4e44-a73e-8eb38ad659c8 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.305709 Oct 23 20:07:18.844140 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 167/353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:18 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:18.884657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:18.885709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:18.894638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.902926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.903791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:18.904737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:18.905376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:18.906062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:19.154031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:19.163555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-42bdcd53-cfd8-4f75-bc0c-2e0d4da3e77e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.283467 Oct 23 20:07:19.167682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 187/354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:18 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:19.409342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:19.410362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:19.431075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:19.432426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:19.433534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:19.434619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:19.435260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:19.435862 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:19.772362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a4bbdc-fae2-4779-a550-4f9c21b29226", "name": "network-vif-plugged", "status": "completed", "tag": "85c41c4a-1d7d-4750-b70c-de441e07d178"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:19.783857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:19.784655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:19.785677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:19.803419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] Creating event network-vif-plugged:85c41c4a-1d7d-4750-b70c-de441e07d178 for instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 on hv-cinder-86243 Oct 23 20:07:19.844663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-4a5703c1-7605-4c43-afdd-c2173efef8ae req-f1153a2a-5aa5-49d4-bea9-1c036f1f2a78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075925 Oct 23 20:07:19.850463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 188/355] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:19.867364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:19.874901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:19.903544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:19.904704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:19.905354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:19.907371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:19.910947 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:19.912253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:20.097940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:20.138454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9db66961-2b3b-4c50-8b0c-0841c37fa62d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.737320 Oct 23 20:07:20.142466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 168/356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:19 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:20.168194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:20.182176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-90641f67-8879-4cfa-876c-5a72dcaf9f0b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.320137 Oct 23 20:07:20.183839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 189/357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:19 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:20.207610 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:20.209643 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:20.220877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:20.221390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:20.221813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:20.222602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:20.223097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:20.223563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:20.453706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:20.465031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f04e9a4c-0f9a-47fa-bb5c-d33b83803d04 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.265310 Oct 23 20:07:20.465602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 169/358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:20 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:21.164490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:21.165186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:21.171210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.171742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.172256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.172956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.173413 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.173847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.204993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:21.206218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:21.218524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.219261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.219890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.220789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.221446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.222211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.425770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:21.434040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:21.436099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-828eade0-9fd0-409e-b773-3b75250cb2da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.276002 Oct 23 20:07:21.436847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 190/359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:21 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:21.452258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-52e25690-3b14-4bf7-adef-97282e577edc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.250594 Oct 23 20:07:21.452926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 170/360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:21 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:21.497940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:21.498950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:21.505549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.506505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.507066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.507860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:21.508446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:21.509078 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:21.669630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:21.679508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-47e6bb45-0bc2-4689-9b5b-425d92140693 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.185608 Oct 23 20:07:21.680072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 191/361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:21 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:22.460389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:22.460910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:22.467706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.468191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.468629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.469317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.469783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.470205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.477220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:22.477909 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:22.483841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.484325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.484753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.485469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.485920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.486371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.691972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:22.695068 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:22.702298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fe116ab2-394a-41d3-9001-31e0ae3fc66d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.246404 Oct 23 20:07:22.702679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-035f2e54-7236-4a18-be06-5bdee4ff725a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.229754 Oct 23 20:07:22.702879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 171/362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:22 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:22.703242 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 192/363] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:22 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:22.708702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:22.708702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:22.714215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.714698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.715133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.715821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:22.716282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:22.716709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:22.861313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:22.869100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-799f2fdd-2d21-462a-ae43-8da0b35248bf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.165205 Oct 23 20:07:22.870360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 172/364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:22 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:23.725772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:23.726439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:23.731562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:23.732172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:23.738520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:23.739627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.740199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.740448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=12 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:23.740849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:23.741618 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.742128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.742781 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:23.746067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.746590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.747027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:23.747737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.748186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.748773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:23.950803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:23.953863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:23.959978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a40c1e9f-adea-4702-a5b2-a910bf3d6d4c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.232130 Oct 23 20:07:23.960552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 173/365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:23 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:23.962358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e4afa3e3-e570-4eb5-a58d-3eafa0b52d58 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.240761 Oct 23 20:07:23.966641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:23.972538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 193/366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:23 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:23.977062 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:23.989787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.990289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.990725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:23.991420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:23.991867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:23.992283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:24.126727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:24.130422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:24.136198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-68fd77b0-56a3-4d61-91f9-5594629ec7d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.174463 Oct 23 20:07:24.136832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 174/367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:23 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:24.987391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:24.987936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:24.988334 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:24.988450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:24.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:24.996614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:24.997201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:24.998065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:24.998553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:24.998978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:24.999276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:24.999783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:25.000600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:25.002143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:25.002846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:25.003711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:25.227839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:25.249255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:25.249255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8131f0db-0052-428e-9ecc-967b028f1c94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.262421 Oct 23 20:07:25.249255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 194/368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:24 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:25.253115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ac3bed05-d0c2-4c75-8291-ee15fa0b0bfe tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.269430 Oct 23 20:07:25.262768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 175/369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:24 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:25.264705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:25.265676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:25.273624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:25.274432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:25.275066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:25.275801 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:25.276255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:25.276687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:25.413969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:25.422766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d3d3b460-765e-4ce3-ab73-7b9a685b30a1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.177245 Oct 23 20:07:25.423348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 195/370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:25 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:26.266997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:26.267749 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:26.277014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.277732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.278384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.279284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.279933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.280533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.288480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:26.289107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:26.295355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.296371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.297110 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.297983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.298640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.299211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.488826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:26.497480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-85208f0d-525b-4b79-9c0f-29c95ae63d31 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.234556 Oct 23 20:07:26.498673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 176/371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:26 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:26.503815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:26.504332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:26.512290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.513149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.513775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.515370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:26.516406 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:26.517061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:26.538318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:26.554846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-72fb4c4d-82fa-45f0-9a70-c52c3386051e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.275003 Oct 23 20:07:26.566655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 196/372] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:26 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:26.709215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:26.717842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a7783ba1-6000-478b-9391-2d0f26c83fc0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.217968 Oct 23 20:07:26.720066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 177/373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:26 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:27.522345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:27.523503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:27.529751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.530562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.531201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.532104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.532746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.533361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.581307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:27.582712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:27.589875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.590627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.591229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.592732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.593208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.593637 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.746049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:27.775504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-50074fba-e836-4e65-9f94-239dc1492509 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.257517 Oct 23 20:07:27.776001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 197/374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:27 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:27.781175 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:27.781978 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:27.796609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.797400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.798835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.799814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:27.800440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:27.801025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:27.850439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:27.863868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-51d1a5cf-3153-4c49-8357-ca84f1d545be tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.286685 Oct 23 20:07:27.873144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 178/375] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:27 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:27.950185 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:27.956688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:27.959416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3047d944-a5a1-45cb-91ff-c18f9008523f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.182173 Oct 23 20:07:27.960073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 198/376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:27 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:28.802608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:28.803868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:28.822489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:28.823354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:28.824448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:28.826623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:28.827350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:28.827736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:28.887400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:28.889881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:28.903862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:28.905078 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:28.906430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:28.908297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:28.908810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:28.909438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:29.027621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:29.035350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6cbd9fc8-5d42-48f2-baf8-e9f26f8c3e92 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.237360 Oct 23 20:07:29.036444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 179/377] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:28 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:29.041110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:29.041712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:29.047431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:29.047919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:29.048359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:29.049045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:29.049500 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:29.049924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:29.086079 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:29.104794 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1a1b5c38-99bd-4f45-921d-9d461fc9b250 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.221196 Oct 23 20:07:29.105387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 199/378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:28 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:29.193991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:29.202607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-20539e42-5c99-4858-ad9c-fab07a274000 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.164948 Oct 23 20:07:29.203179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 180/379] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:29 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:30.058906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:30.059514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:30.065389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.065864 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.066308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.066985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.067430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.067873 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.128052 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:30.128752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:30.145894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.146437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.146870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.147565 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.148021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.148440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.229165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:30.237191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7c3f1433-197e-4c6a-b694-e702b0386ccb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.182070 Oct 23 20:07:30.237759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 200/380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:30 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:30.242104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:30.242729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:30.248746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.249224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.249649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.250362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:30.250812 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:30.251227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:30.302224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:30.309962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bb0cf897-3659-4f98-8733-91299536cac2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.185786 Oct 23 20:07:30.310556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 181/381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:30 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:30.387549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:30.395106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-42a3f806-330a-45cb-83e4-425edb60c5e3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.156426 Oct 23 20:07:30.396222 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 201/382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:30 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:31.260007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:31.260611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:31.267127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.267612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.268043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.268736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.269189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.269614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.333483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:31.334543 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:31.340015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.340572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.341001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.341687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.342138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.342580 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.424392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:31.432557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-eaa05142-fc71-4dc6-a8e0-d3d588533460 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.176350 Oct 23 20:07:31.433129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 182/383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:31 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:31.437544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:31.438151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:31.444885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.445485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.445924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.446651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:31.447109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:31.447535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:31.496256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:31.503999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-55d8a317-b3d5-4264-974e-9e71713c350f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.174894 Oct 23 20:07:31.504562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 202/384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:31 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:31.582902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:31.590492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ce9e61e8-5097-4bda-b271-a390027dfbeb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.156394 Oct 23 20:07:31.591054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 183/385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:31 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:32.456345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:32.456904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:32.463194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.463663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.464083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.464751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.465194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.465608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.527568 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:32.528308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:32.535405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.536095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.536719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.537581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.538101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.538773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.620023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:32.627724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2b73ceeb-a073-4386-adf8-b2d91b3f446e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.175261 Oct 23 20:07:32.628291 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 203/386] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:32 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:32.633086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:32.633677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:32.639799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.640282 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.640701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.641386 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:32.641831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:32.642275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:32.694408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:32.702439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-74980706-3dbb-4ce6-b0ad-67d7438e7759 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.178772 Oct 23 20:07:32.703005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 184/387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:32 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:32.775659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:32.783165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-71cc0393-a418-461c-b920-5aa6e6c0d55c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.153948 Oct 23 20:07:32.783721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 204/388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:32 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:33.650898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:33.651509 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:33.657991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.658518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.658952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.659634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.660086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.660503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.725492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:33.726753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:33.732520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.733010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.733430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.734113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.734631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.735048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.822727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:33.830636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-587f6023-f192-4039-9ac6-4d07110f0d41 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.183520 Oct 23 20:07:33.831205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 185/389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:33 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:33.836825 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:33.837420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:33.850712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.850712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.850712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.850712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:33.851455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:33.851455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:33.912963 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:33.926782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b951ce52-c594-4114-9a29-9726453ec7c2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.205536 Oct 23 20:07:33.927470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 205/390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:33 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:34.015870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:34.024363 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1d6f99dc-67eb-482c-bc3e-fb2f4131e435 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.192134 Oct 23 20:07:34.024933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 186/391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:33 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:34.852971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:34.853589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:34.860031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:34.860512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:34.860941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:34.861623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:34.862076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:34.862512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:34.951228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:34.951846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:34.962234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:34.962922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:34.963436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:34.964219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:34.964782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:34.965279 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:35.025896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:35.035679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1f5d91d0-f745-4e54-9e18-08a308aa022e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.186464 Oct 23 20:07:35.036479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 206/392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:34 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:35.051705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:35.052535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:35.060862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:35.061344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:35.061773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:35.062492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:35.062972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:35.063384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:35.118203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:35.126699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7d8a594b-b05f-4227-8a1f-45a0df629918 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.179369 Oct 23 20:07:35.127285 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 187/393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:34 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:35.207357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:35.215422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8bd5d504-d1c0-4914-893e-3617d4164df1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.167578 Oct 23 20:07:35.215981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 207/394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:35 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:36.059734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:36.060351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:36.066707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.067194 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.067625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.068314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.068770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.069193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.163667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:36.164273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:36.171148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.171148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.171148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.171843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.172292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.172703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.199908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:36.208695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0567537c-8fd5-43e4-8718-594645b583fc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.152670 Oct 23 20:07:36.218322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 188/395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:36 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:36.237447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:36.238051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:36.244013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.244502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.244934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.245629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:36.246081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:36.246531 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:36.333599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:36.341246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7e0ed26d-7480-4686-8666-8498ae8023c0 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.181909 Oct 23 20:07:36.341824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 208/396] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:36 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:36.392048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:36.400208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2c9e7f62-1c7b-4e40-8064-3ee67f0c7587 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.166581 Oct 23 20:07:36.400764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 189/397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:36 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:37.231930 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:37.232546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:37.238446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.238931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.239366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.240059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.240517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.240939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.363780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:37.364367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:37.366085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:37.370806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.371293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.371730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.372427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.372883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.373308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.373662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4eaaaf9e-c310-4af6-ab68-409834c3e04e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.145561 Oct 23 20:07:37.374218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 209/398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:37 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:37.422932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:37.423539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:37.429475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.429967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.430440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.431127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:37.431605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:37.432029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:37.543355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:37.551099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-06b0e78d-e312-44ac-beae-f2b21f4dbb6b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.191180 Oct 23 20:07:37.552218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 190/399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:37 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:37.587488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:37.595271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c904bba2-3c59-4125-929c-9c89adc4b8d3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.176393 Oct 23 20:07:37.595826 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 210/400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:37 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:38.396824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:38.397521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:38.404016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.404501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.404933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.405620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.406072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.406526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.424600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:38.551676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:38.559885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bcdabe90-76cc-4ce0-aaeb-8c43a327f9d5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.166941 Oct 23 20:07:38.560560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 191/401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:38 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:38.583675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:38.584380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:38.592419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.593045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.593486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.594260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.595003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.595435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.618881 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:38.619529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:38.625498 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.625982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.626440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.627137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.632782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.632782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.878022 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:38.885898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-058e6635-ef8b-49c5-ad67-39bea78aa499 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.315974 Oct 23 20:07:38.891061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 211/402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:38 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:38.893913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:38.896353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:38.903287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c4d8cf6f-b87b-445c-9217-373a0562189d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.288729 Oct 23 20:07:38.906437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 192/403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:38 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:38.906533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:38.906533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:38.906911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:38.917938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] Creating event network-changed:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:07:38.922799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-5be5004b-d1c5-4548-b1a2-5e68dc79c0e9 req-e255a5a5-4ab4-42e5-82a4-a6b062c3ca92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030466 Oct 23 20:07:38.923368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 212/404] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:39.584263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:39.584873 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:39.591367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.591846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.592272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:39.592952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.593402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.593818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:39.723146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:39.731397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7090ad43-1886-47b5-b73c-ece1282cf587 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.151547 Oct 23 20:07:39.732013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 193/405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:39 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:39.909756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:39.910519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:39.916625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.917105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.917535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:39.918220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.918701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.919123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:39.925727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:39.926844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:39.932573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.933044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.933467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:39.934141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:39.934624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:39.935041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:40.119025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:40.126805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-164b5b86-ea74-4e9a-8756-a413f999c3bf tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.221373 Oct 23 20:07:40.127393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 213/406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:39 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:40.129882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:40.137551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-860ea071-9dc7-4d3d-becf-2e830e9e0893 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.215577 Oct 23 20:07:40.138109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 194/407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:39 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:40.756069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:40.756684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:40.762765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:40.763284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:40.763777 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:40.764567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:40.765123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:40.765550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:40.897615 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:40.905267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-52309afd-6736-4bb0-8576-901315d6f59c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.153032 Oct 23 20:07:40.905833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 214/408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:40 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:41.149502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:41.150113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:41.156551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.157040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.157474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:41.158160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.158639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.159059 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:41.159438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:41.160049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:41.165979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.166494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.166927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:41.167612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.168070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.168490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:41.343556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:41.348692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:41.351224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-845f2cf0-0487-46ae-a9b9-2cfe81788820 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.205559 Oct 23 20:07:41.351797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 195/409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:41 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:41.356436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a3664c80-ff68-4bf5-bc96-fdd8d7be3965 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.200746 Oct 23 20:07:41.356999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 215/410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:41 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:41.929064 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:41.929917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:41.933631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=74 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:41.937959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.938478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.938934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:41.939654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:41.940105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:41.940522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:42.088621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:42.096851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-795734c0-058a-4752-9c08-618142462777 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.172589 Oct 23 20:07:42.097588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 196/411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:41 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:42.381701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:42.384012 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:42.386420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:42.390212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:42.407336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:42.408627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:42.409972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:42.412109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:42.413020 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:42.413583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:42.414135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:42.414741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:42.420252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:42.421382 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:42.422020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:42.422598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:42.426871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:42.649551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:42.653396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:42.657519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9fb25714-ea6a-40fc-8961-48cdf2f41b0e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.281776 Oct 23 20:07:42.658096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 197/412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:42 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:42.661528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6d32343d-3800-4a55-b5a5-0db6595c9bb6 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.290331 Oct 23 20:07:42.662080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 216/413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:42 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:43.121220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:43.121826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:43.127653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.128155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.128585 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.129311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.129739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.130157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.258541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:43.266293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f113e3f4-f3b5-4560-b340-739f89680b52 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.149971 Oct 23 20:07:43.266876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 198/414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:43 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:43.680862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:43.681465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:43.683308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:43.683778 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:43.684390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:43.687924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.688408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.688833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.689517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.690054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.690535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.690844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.691325 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.691779 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.692542 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:43.693006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:43.693433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:43.894674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:43.899226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:43.903357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9e80daa4-210e-44c2-a41e-eb2415125536 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.226347 Oct 23 20:07:43.904097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 217/415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:43 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:43.907252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-369c7d42-48dd-4f1f-9cf0-4ef6b24d6b4e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.227375 Oct 23 20:07:43.907892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 199/416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:43 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:44.289186 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:44.289787 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:44.295775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.296264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.296701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:44.297395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.297851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.298306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:44.426223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:44.434477 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9e8a18d4-713b-4e28-ab3b-065f9776c17c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.149522 Oct 23 20:07:44.435048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 218/417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:44 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:44.930423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:44.930862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:44.931229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:44.931571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:44.937978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.938386 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.938513 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.938964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:44.939142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.939663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.939759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:44.940128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.940557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:44.940672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:44.941220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:44.941735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:45.234132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:45.242771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1299d2f0-73e3-4343-8c04-e80c137eafb5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.316726 Oct 23 20:07:45.243342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 219/418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:44 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:45.253846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:45.262195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-660cf448-e2ea-4997-8cfc-28e5a9e3d72e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.339127 Oct 23 20:07:45.262861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 200/419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:44 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:45.457699 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:45.458595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:45.465949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:45.466596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:45.467113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:45.468019 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:45.468487 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:45.468893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:45.620235 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:45.629047 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e4a64884-9ef1-4c66-9618-1625190bec9f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.175185 Oct 23 20:07:45.630015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 220/420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:45 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:46.266707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:46.267322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:46.277114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.277606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.279836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.281029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.281683 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.282918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.284431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:46.285213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:46.293437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.293965 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.294692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.295647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.296475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.297210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.750466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:46.760616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e69d6a17-968f-4e0b-b806-f7c576fd87b3 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.497719 Oct 23 20:07:46.761600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 201/421] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:46 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:46.762850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:46.770430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:46.770695 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b3035618-a99b-4f88-b067-cbb466d7cc07 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.490262 Oct 23 20:07:46.771485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:46.782597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.782597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.782597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.782597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:46.782930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:46.782930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:46.783548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 221/422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:46 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:46.913948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:46.921936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5952314a-5e1b-47a0-86c9-b544a6b3c038 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.158934 Oct 23 20:07:46.922559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 202/423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:46 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:47.784165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:47.784902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:47.792614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:47.793502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:47.794259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:47.794753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:47.795211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:47.795371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:47.795654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:47.796087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:47.801455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:47.801955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:47.802418 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:47.803616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:47.804071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:47.804492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:48.013808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:48.017262 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:48.024363 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0790a390-efe0-4b17-b3a4-b34eb138157d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.234105 Oct 23 20:07:48.025385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 203/424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:47 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:48.030162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:48.030805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:48.032696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c8eb85b0-38cb-45b8-b7e1-e88fd53c270a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.252129 Oct 23 20:07:48.033428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 222/425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:47 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:48.036970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:48.038192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:48.038820 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:48.039680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:48.040289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:48.040865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:48.178800 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:48.186519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e17bf32d-bcf2-4fe3-85d0-87ec35cfc28b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.159865 Oct 23 20:07:48.187089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 204/426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:48 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:49.047097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:49.047723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:49.055355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.056148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.056776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.057707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.058568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.059184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.061529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:49.062396 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:49.072030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.072725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.073329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.074439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.074903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.075484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.268657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:49.272360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:49.277357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b951ee23-1808-4035-8b05-2815a54b7588 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.234147 Oct 23 20:07:49.278018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 223/427] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:49 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:49.291926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2ed55b63-bad2-45dc-8a7a-5a9a5a247a42 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1314 microversion: 2.1 time: 0.223815 Oct 23 20:07:49.291926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 205/428] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:49 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:49.292163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:49.292163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:49.292163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.292163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.292478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.292478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:49.292478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:49.292478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:49.420503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:49.430620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0a19917c-69a0-43d8-b1bd-9ac6f55ecda5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.151405 Oct 23 20:07:49.431333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 224/429] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:49 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:50.301805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:50.302389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:50.303111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:50.303789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:50.308845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.309352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.309627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.309779 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.310107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.310493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.310593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.310942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.311238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.311355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.311686 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.312125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.503649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:50.508267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:50.513115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f0e3b271-483a-455a-9da4-b32ca8d6ed99 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.215306 Oct 23 20:07:50.513777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 206/430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:50 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:50.516959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eff99694-f28f-479a-87ce-341250307946 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1499 microversion: 2.1 time: 0.217721 Oct 23 20:07:50.517644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 225/431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:50 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1499 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:50.519030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:50.519635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:50.526452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.526943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.527375 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.528069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:50.528525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:50.528949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:50.662118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:50.669807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-78a89727-c2fb-49b2-84db-7765cf74e129 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.154755 Oct 23 20:07:50.670390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 207/432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:50 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:51.481428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "name": "network-vif-plugged", "status": "completed", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:07:51.491211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:51.491769 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:51.492350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:51.504116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] Creating event network-vif-plugged:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:07:51.509856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-aba4edec-d9fa-4103-b732-bdd393382d08 req-472161ac-e95e-4a12-b548-d5626a87f73d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Oct 23 20:07:51.510652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 226/433] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:07:51.536304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:51.536914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:51.544236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:51.544830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:51.545626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:51.546614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:51.547305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:51.547858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:51.552479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:51.684068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:51.692595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f7f8362a-8cd9-47fa-a1ac-341214efb0f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.159959 Oct 23 20:07:51.693036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:51.693532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 208/434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:51 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:51.693966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:51.700542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:51.701032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:51.701491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:51.702211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:51.703018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:51.703441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:51.855830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:51.863406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a8dda384-1732-4d19-b8dc-bb9eba542798 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.174834 Oct 23 20:07:51.863978 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 227/435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:51 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:52.715764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:52.716444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:52.723169 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:52.723660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:52.724091 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:52.726563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:52.727327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:52.727915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:52.860693 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:52.868897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-379d3c73-b4d0-4b5d-92e3-fd8e1b7b1bdc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1520 microversion: 2.1 time: 0.156956 Oct 23 20:07:52.869459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 209/436] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:52 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:52.884718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:52.885438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:52.891390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:52.891867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:52.892293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:52.892976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:52.893423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:52.893841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.026875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:53.034403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-25f0cd9d-830e-4415-ab5f-1f1fe6134e94 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.153506 Oct 23 20:07:53.034971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 228/437] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:52 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:53.652791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:53.653286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:53.660866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.660866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.660866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.661215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.662775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.662775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.687834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:07:53.762086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8eea5322-6f73-494d-bc7e-ef40b12a0d12 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 204 len: 0 microversion: 2.1 time: 0.112814 Oct 23 20:07:53.762823 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 210/438] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:07:53 2022] DELETE /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:07:53.770932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:53.771598 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:53.778104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.778616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.779045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.779722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.780174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.780590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.891425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:53.892165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:53.898566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.899081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.899520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.900215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:53.900673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:53.901099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:53.911182 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:53.919606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-376f98b5-eea2-414f-9b81-f669a78b6814 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.152601 Oct 23 20:07:53.920170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 229/439] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:53 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:54.029221 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:54.036859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-db8b354f-e04b-4373-a39b-993cc415283e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1500 microversion: 2.1 time: 0.149637 Oct 23 20:07:54.037970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 211/440] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:53 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1500 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:54.056706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:54.057410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:54.058503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:54.059111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:54.063654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.064137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.064566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:54.064808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.065255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.065353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.065697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:54.065801 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.066149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:54.066424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.066876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.067298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:54.259164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:54.263321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:54.266883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6bd9df07-f199-4353-949b-f723793df7c5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.213982 Oct 23 20:07:54.267450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 230/441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:54 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:54.271208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e657ccf0-4707-4658-99ca-2a53397a6db1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1515 microversion: 2.1 time: 0.216244 Oct 23 20:07:54.272430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 212/442] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:54 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:07:54.942818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:54.943858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:54.950081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.950617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.951031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:54.951717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:54.952173 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:54.952594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:55.084745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:55.092444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-133a0323-887b-4fbf-ad20-c4baaafea226 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.153476 Oct 23 20:07:55.093003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 231/443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:54 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:55.289826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:55.290385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:55.296710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:55.297194 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:55.297624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:55.298343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:55.298801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:55.299225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:55.424793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:55.432955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-641ecb1a-e64d-4693-9c03-fde05fe05b87 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.147095 Oct 23 20:07:55.433549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 213/444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:55 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:56.115829 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:56.116432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:56.122371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:56.122849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:56.123272 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:56.123950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:56.124399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:56.124814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:56.261910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:56.269692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-15059140-cf15-4c71-9a5e-87fd789e6792 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.158205 Oct 23 20:07:56.270267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 232/445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:56 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:56.455699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:56.456216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:56.462666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:56.463139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:56.463563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:56.464238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:56.464684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:56.465098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:56.589811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:56.597431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dfee0267-6afb-4a5c-9171-7830f5a5a3c0 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.145643 Oct 23 20:07:56.598000 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 214/446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:56 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:57.291881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:57.292494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:57.298363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:57.298837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:57.299261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:57.299932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:57.300376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:57.300788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:57.318790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:57.426307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:57.433842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dd625f11-7f52-41b4-a17b-60b3ba2ba304 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.145772 Oct 23 20:07:57.434424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 233/447] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:57 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:57.620885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:57.621495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:57.627801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:57.628278 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:57.628705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:57.629388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:57.629837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:57.630273 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:57.761718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:57.769310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fc9e0f00-f7fc-4326-be12-1a15dc4b6a20 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.152357 Oct 23 20:07:57.769875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 215/448] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:57 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:58.456821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:58.457470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:58.464036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:58.464521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:58.464958 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:58.465644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:58.466101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:58.466556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:58.591447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:58.599013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-46823adc-8cd5-4f2c-9bb8-847572216642 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.146072 Oct 23 20:07:58.600197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 234/449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:58 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:58.791546 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:58.792159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:58.798705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:58.799190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:58.799620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:58.800309 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:58.800759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:58.801209 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:58.930296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:58.937834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e91551c3-954d-49ac-a4ea-9b51d3fa745f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.150057 Oct 23 20:07:58.938437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 216/450] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:58 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:59.622312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:59.622910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:59.628939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:59.629408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:59.629834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:59.630616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:59.631062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:59.631475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:59.761706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:07:59.769255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-06c8ae34-a356-4ca9-ae4b-ccf835863ba2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.150800 Oct 23 20:07:59.769825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 235/451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:59 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:07:59.962086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:07:59.962739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:07:59.969514 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:59.969997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:59.970471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:07:59.971159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:07:59.971627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:07:59.972032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:00.150351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:00.163274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2d087eb0-01b5-40ce-b2f9-e8357eaf720d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1359 microversion: 2.1 time: 0.201088 Oct 23 20:08:00.164198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 217/452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:07:59 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:00.792543 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:00.793141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:00.799387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:00.799880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:00.800314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:00.801009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:00.801463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:00.801887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:00.903950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:00.906449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:00.912530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:00.913083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:00.913580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:00.914366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:00.914891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:00.915381 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:00.933625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:00.939953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'flavor' on Instance uuid df8837d8-442b-4b75-b896-e07e4a04391f {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:00.941355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1c731a5f-1b8a-48cb-92e6-b011b25dacfc tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1505 microversion: 2.1 time: 0.152610 Oct 23 20:08:00.941926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 236/453] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:00 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:01.055306 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d4ef74cf-d651-425c-9fbf-439bf2adcde1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/action" status: 200 len: 32 microversion: 2.1 time: 0.155140 Oct 23 20:08:01.055911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 218/454] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:08:00 2022] POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 20:08:01.065673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.066309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:01.073035 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.073751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.074399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.075108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.075723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.076312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.188922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.189757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:01.197571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.198066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.198575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.199304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.199758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.200183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.235749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:01.243780 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2cda150e-9a12-4f31-8919-78e8df9d091c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.181797 Oct 23 20:08:01.244256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 237/455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:01.332074 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:01.340189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1b33c089-e76a-4526-80bf-f45ce7ae9668 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1549 microversion: 2.1 time: 0.155486 Oct 23 20:08:01.340760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 219/456] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:01.363130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.363777 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:01.369594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.370089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.370533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.371214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.371665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.372081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.627901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:01.647943 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5339d8e3-fc98-4291-8178-ed45a4a8a4ed tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1549 microversion: 2.1 time: 0.288577 Oct 23 20:08:01.650704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 238/457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1549 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:01.670434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.679166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:01.679954 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Searching by: {'deleted': False, 'project_id': '6b4261a7b9e642e5ba063a4790296b66'} {{(pid=118866) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 20:08:01.690392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.691060 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.691676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.693030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.694337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.695065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.816501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.multi_cell_list [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 20:08:01.915053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:01.935862 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2d8254e6-6695-477e-8779-c1ba81053cee tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.268347 Oct 23 20:08:01.936952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 220/458] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:01.953456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.954915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:01.971418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.975606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.976418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.977338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:01.977914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:01.979305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:01.980503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:01.981796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:01.997436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:02.008091 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:02.008768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:02.009556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:02.009984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:02.010468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:02.141685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:02.150202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-367f9a17-b029-4588-a696-28b8af185106 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1463 microversion: 2.1 time: 0.187704 Oct 23 20:08:02.151066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 221/459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:02.155879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a4bbdc-fae2-4779-a550-4f9c21b29226", "name": "network-vif-deleted", "tag": "85c41c4a-1d7d-4750-b70c-de441e07d178"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:02.167584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:02.168153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:02.168588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:02.182649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] Creating event network-vif-deleted:85c41c4a-1d7d-4750-b70c-de441e07d178 for instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 on hv-cinder-86243 Oct 23 20:08:02.191127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-91809ea7-baab-4ca5-ae7e-7e26f7f7f66a req-51fe0e6d-f9e8-454c-9003-1c2b4655d614 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038044 Oct 23 20:08:02.192763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 222/460] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:02.264679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:02.269430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:02.270838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:02.272492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fe880eb2-e5b1-40e5-a10a-841d0ff0df64 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1549 microversion: 2.1 time: 0.326598 Oct 23 20:08:02.273292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 239/461] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:01 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1549 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:02.278662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:02.279092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:02.279518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:02.280205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:02.280647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:02.281631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:02.428511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:02.436656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-517186d6-383f-4218-bc09-c5ef95142176 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.172922 Oct 23 20:08:02.437378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 223/462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:02 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:03.174349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:03.175059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:03.181949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:03.182457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:03.182883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:03.183554 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:03.184000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:03.184412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:03.216495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:03.216975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:03.217408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:03.218027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 65a4bbdc-fae2-4779-a550-4f9c21b29226 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:03.266124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:03.273800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4e5c18bc-e51a-434b-9295-9c4b444175df tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1304 microversion: 2.1 time: 0.103455 Oct 23 20:08:03.274575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 240/463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:03 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:03.460245 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:03.460850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:03.467863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:03.468578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:03.469114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:03.469873 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:03.470685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:03.471116 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:03.602391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:03.610297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5c3c2a8a-d8ea-40ab-bb5d-6ac37b915020 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.153845 Oct 23 20:08:03.610876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 224/464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:03 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:04.298220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:04.299090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:04.305642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:04.306125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:04.306586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:04.307268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:04.307750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:04.308168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:04.339846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:04.340327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:04.340758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:04.341188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 65a4bbdc-fae2-4779-a550-4f9c21b29226 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:04.383029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:04.390774 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9bb2f44d-3464-44ec-8bf0-433b2172521d tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1304 microversion: 2.1 time: 0.096478 Oct 23 20:08:04.391336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 241/465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:04 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:04.632915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:04.633885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:04.642289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:04.643279 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:04.643990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:04.644776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:04.645315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:04.645805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:04.783758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:04.791500 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a2ab909b-f051-4f36-a0b8-fee04ea53a7d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.162416 Oct 23 20:08:04.792008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 225/466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:04 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:05.414162 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:05.414724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:05.420663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:05.421140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:05.421570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:05.422265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:05.422724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:05.423142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:05.452749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:05.453217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:05.453644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:05.454075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 65a4bbdc-fae2-4779-a550-4f9c21b29226 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:05.493490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:05.500989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-68ce50e9-0336-475f-9f7d-edd77807a876 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 200 len: 1304 microversion: 2.1 time: 0.091371 Oct 23 20:08:05.501552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 242/467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:05 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:05.813074 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:05.813674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:05.821399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:05.821972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:05.822564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:05.823441 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:05.823948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:05.824366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:05.952289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:05.960159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-eed55301-1553-4f72-8474-8d27d2b9d30b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.150709 Oct 23 20:08:05.960784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 226/468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:05 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:06.524170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:06.524708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 65a4bbdc-fae2-4779-a550-4f9c21b29226] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:06.530566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:06.531055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:06.531458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:06.532128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:06.532572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:06.532984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:06.546480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] HTTP exception thrown: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Request method failure captured: Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 HTTP/1.1 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ7dIB_ZgzAEYXXX1-2bFY9XvRVj4b7JA8Pg-OkIRTLVuzn0weYzbF4hlViJG5JMULO1taKPYNXTkcdSfT7XxE6Ag8Wk6BMBfumIxTWvbJO4Vk5L0Mf9qZRA8mneF5l_-cf8iOlaWH2LfK8jk0QRtQTiGgbPXqgSYPseSSJ-xMb4h8I Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 46b77aad0457485693b9a43b85506915 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:08:06.548066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46b77aad0457485693b9a43b85506915", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46b77aad0457485693b9a43b85506915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46b77aad0457485693b9a43b85506915"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46b77aad0457485693b9a43b85506915"}]}] Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 46b77aad0457485693b9a43b85506915 Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesActionsTest-1876259199-project Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 48be37e3311a4d6c968b135f8e5ee536 Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesActionsTest-1876259199-project Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. Oct 23 20:08:06.549589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '65a4bbdc-fae2-4779-a550-4f9c21b29226'} Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:08:06.550526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. Oct 23 20:08:06.552034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:06.553906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Returning 404 to user: Instance 65a4bbdc-fae2-4779-a550-4f9c21b29226 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:08:06.553906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ac085019-77f3-4a9e-9877-34e3e6f1f9b7 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226" status: 404 len: 111 microversion: 2.1 time: 0.029228 Oct 23 20:08:06.553906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 243/469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:06 2022] GET /compute/v2.1/servers/65a4bbdc-fae2-4779-a550-4f9c21b29226 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:08:06.653750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-251476417", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "networks": [{"uuid": "bc4941ab-4461-4d24-b235-1a82a516c52f"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:06.705538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] validate_networks() for [('bc4941ab-4461-4d24-b235-1a82a516c52f', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:08:06.983460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:06.984076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:06.989878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:06.990404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:06.990842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:06.991534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:06.991989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:06.992411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:07.077791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:08:07.078308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:08:07.078689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:08:07.079090 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:08:07.079493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:08:07.088579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:07.089072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:07.089538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:07.090182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:07.090738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:07.091155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:07.107299 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Getting quotas for project 46b77aad0457485693b9a43b85506915. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:08:07.111255 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Getting quotas for user 48be37e3311a4d6c968b135f8e5ee536 and project 46b77aad0457485693b9a43b85506915. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:08:07.121804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:08:07.124137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:08:07.139560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:07.148101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9d45ed00-079e-4f24-96e1-18d82166ac6e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.168536 Oct 23 20:08:07.148772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 244/470] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:06 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:07.170392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3c42856b-c945-48f5-a167-dd571ecca064 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520387 Oct 23 20:08:07.171039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 227/471] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:08:07.182102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a84b5c88-dc56-49ee-97f0-973231663513 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:07.182745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a84b5c88-dc56-49ee-97f0-973231663513 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:07.250450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a84b5c88-dc56-49ee-97f0-973231663513 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:07.258547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a84b5c88-dc56-49ee-97f0-973231663513 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1213 microversion: 2.1 time: 0.080151 Oct 23 20:08:07.259108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 245/472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:07 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:08.082412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6185ce2-5bd6-4954-baf2-cdf56102ffb5"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:08.085258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:08.092044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.092531 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.092969 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.093666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.094124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.094582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.172323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:08.173048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:08.179009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.179494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.179930 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.180623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.181084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.181507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.320548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:08.341195 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3161e62f-0639-441d-b9dd-4344d7505f1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.172767 Oct 23 20:08:08.342387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 246/473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:08 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:08.347463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:08.348327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:08.357863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.358615 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.359264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.360512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:08.361200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:08.361861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:08.502054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:08.513593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-343e48b3-fb22-4232-843e-0e52287ee54c tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1265 microversion: 2.1 time: 0.168981 Oct 23 20:08:08.514196 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 247/474] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:08 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:08.574100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e562e886-509b-491c-8944-4927c146c7c8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495925 Oct 23 20:08:08.574955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 228/475] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:08:08 2022] POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:09.365582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:09.366326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:09.372253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:09.372804 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:09.373321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:09.374028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:09.374499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:09.375005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:09.539051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:09.539833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:09.546808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:09.547529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:09.548139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:09.548989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:09.549512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:09.550009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:09.570659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:09.583290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ee5c87f3-8da6-4013-b063-cadc909c0efc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.222125 Oct 23 20:08:09.584412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 248/476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:09 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:09.777523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:09.785254 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ba7f1527-f547-4a8b-8b74-623829300f24 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.252068 Oct 23 20:08:09.785816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 229/477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:09 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:10.082187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e47422-88b9-49c7-9046-4b4627d1b2e4", "tag": "3c035e36-fdd3-4b20-82eb-f0cefea6a5fb"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:10.099364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:10.099843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:10.100270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:10.111552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] Creating event network-changed:3c035e36-fdd3-4b20-82eb-f0cefea6a5fb for instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 on hv-cinder-86243 Oct 23 20:08:10.117520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-7a6bc24d-7859-4ed4-85b7-bad7540aa15f req-27a8aafb-a966-4d17-995e-e02eab465014 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038914 Oct 23 20:08:10.118192 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 249/478] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:08:10.606840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:10.607480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:10.613872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:10.614379 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:10.615347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:10.616035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:10.616489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:10.616908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:10.806369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:10.822913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:10.822913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:10.832075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:10.832701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:10.833244 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:10.834405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:10.835028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:10.835550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:10.835668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5f0ee322-ffb5-4fa3-bc3f-918014020a76 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.231819 Oct 23 20:08:10.836910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 230/479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:10 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:10.991503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:10.999102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d3730a74-59fd-4f40-86ef-065576c43f86 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.193435 Oct 23 20:08:10.999670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 250/480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:10 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:11.861152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:11.862433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:11.870831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:11.871569 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:11.872171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:11.873043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:11.873659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:11.874262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:12.029065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:12.033443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:12.035083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:12.049485 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:12.050058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:12.051511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-27c61386-f141-4261-878e-ada18e889f47 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.191059 Oct 23 20:08:12.052737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 231/481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:11 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:12.053454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:12.054310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:12.054953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:12.055380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:12.075415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:12.205486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:12.216140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1a77fdb7-db02-45fd-a4de-d25f260ccb63 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.198311 Oct 23 20:08:12.216753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 251/482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:12 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:13.076483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:13.077084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:13.079714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:13.086849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:13.087501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:13.087999 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:13.088802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:13.089564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:13.090263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:13.223407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:13.231281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d54d1d43-0e6f-4ce7-97b4-219327982da3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.158587 Oct 23 20:08:13.231861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 232/483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:13 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:13.251421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:13.252026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:13.258668 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:13.259211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:13.259645 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:13.260331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:13.260778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:13.261215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:13.461530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:13.475673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-19a898fe-d210-4ab5-a99f-4f4d19d7dc52 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.227218 Oct 23 20:08:13.491074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 252/484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:13 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:14.254727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:14.255858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:14.262948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:14.263826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:14.264266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:14.265435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:14.265822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:14.266262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:14.407417 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:14.415867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-36b8e846-6eb8-4860-b017-1f8fbaed937f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.164996 Oct 23 20:08:14.416446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 233/485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:14 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:14.500626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:14.501234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:14.503784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=80 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:14.509594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:14.510071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:14.510530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:14.511210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:14.511658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:14.512072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:14.640209 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:14.648303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5a6fdcac-d36c-4cc1-9726-05ef8f92ff3a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.151413 Oct 23 20:08:14.648866 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 253/486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:14 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:15.438553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:15.439162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:15.446280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:15.446760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:15.447192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:15.447870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:15.448320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:15.448737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:15.579286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:15.586901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-21e631c6-fd70-4731-89b3-f09f603dd87e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.152228 Oct 23 20:08:15.587462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 234/487] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:15 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:15.670360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:15.670906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:15.676853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:15.677872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:15.678331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:15.679016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:15.679470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:15.679893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:15.803734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:15.811255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c93a3a19-362e-42ec-9f84-bddc9eb79146 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.144858 Oct 23 20:08:15.811818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 254/488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:15 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:16.609291 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:16.609926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:16.616318 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:16.616797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:16.617231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:16.617909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:16.618394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:16.618816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:16.753976 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:16.762212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-97b0db6d-571b-48e1-bb16-55ee49cb4ba9 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.156797 Oct 23 20:08:16.762801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 235/489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:16 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:16.835135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:16.835742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:16.841569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:16.842044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:16.842509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:16.843190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:16.843652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:16.844072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:16.971878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:16.979529 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e476714e-2cba-420a-b317-49788644835e tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.148811 Oct 23 20:08:16.980120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 255/490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:16 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:17.785415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:17.785954 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:17.788278 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:17.788966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:17.795886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:17.796366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:17.797056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:17.797748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:17.798227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:17.798671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:17.925723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:17.933399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b9cd4e31-34de-4ea3-8e69-7b2e5e712e93 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.151895 Oct 23 20:08:17.933965 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 236/491] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:17 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:18.001292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:18.002008 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:18.004014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:18.009406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:18.009885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:18.010340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:18.011027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:18.011478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:18.011895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:18.142214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:18.150411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ee3fc8a9-cf11-45d6-a622-ea6b5014f2d1 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.152777 Oct 23 20:08:18.150970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 256/492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:17 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:18.959058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:18.959687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:18.965977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:18.966495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:18.966925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:18.967598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:18.968044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:18.968455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:18.985883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:19.096940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:19.105100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-af80f49c-7bb3-4cbc-ab2d-6399170c4cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.150016 Oct 23 20:08:19.105665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 237/493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:18 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:19.173965 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:19.174593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:19.181213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:19.181695 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:19.182119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:19.182831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:19.183280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:19.183701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:19.316870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:19.324644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f6d9763e-47a3-45d5-9875-4177a338f9e2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.154427 Oct 23 20:08:19.325209 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 257/494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:19 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:19.379398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e47422-88b9-49c7-9046-4b4627d1b2e4", "name": "network-vif-plugged", "status": "completed", "tag": "3c035e36-fdd3-4b20-82eb-f0cefea6a5fb"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:19.390549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:19.391648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:19.392082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:19.405631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] Creating event network-vif-plugged:3c035e36-fdd3-4b20-82eb-f0cefea6a5fb for instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 on hv-cinder-86243 Oct 23 20:08:19.411430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-f4c93a9c-a189-409b-be26-e684be038a75 req-654e04eb-eacf-45c3-9ced-baf178b08085 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Oct 23 20:08:19.412563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 238/495] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:20.127135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:20.127740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:20.133562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.134072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.134533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.136520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.137302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.137885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.297680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-597412773", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:20.374646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:20.383596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] validate_networks() for None {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:08:20.384131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-58a28816-f3dc-4201-9d0d-a9e0bc11f265 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.260404 Oct 23 20:08:20.398681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 258/496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:20 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:20.403923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:20.404583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:20.412210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.412925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.413421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.414181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.414725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.416170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.724600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:20.735831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-02a12f96-5cc0-4923-b659-a1feb8c5479f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.335679 Oct 23 20:08:20.736486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 259/497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:20 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:20.768505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:08:20.768925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:08:20.769407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:08:20.769819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:08:20.770226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:08:20.780230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.780719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.781336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.782129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:20.782821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:20.783250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:20.809547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Getting quotas for project ae31769b5e4c4b2e9680f86cd820784f. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:08:20.813955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Getting quotas for user c9cf226192c94300bafdd3bac13ab8bc and project ae31769b5e4c4b2e9680f86cd820784f. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:08:20.827080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:08:20.829671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:08:20.887312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4818d9cc-4ac1-4ff2-8ead-a8d8e71d27af tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593624 Oct 23 20:08:20.893847 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 239/498] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 20:08:20.902499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d31aa22-1069-46f8-af8f-b6aa6c24b6c8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:20.903510 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9d31aa22-1069-46f8-af8f-b6aa6c24b6c8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:20.964524 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9d31aa22-1069-46f8-af8f-b6aa6c24b6c8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:20.971420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9d31aa22-1069-46f8-af8f-b6aa6c24b6c8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1214 microversion: 2.1 time: 0.076104 Oct 23 20:08:20.971976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 260/499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:20 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:21.416799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:21.417514 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:21.425634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.426195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.426734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.427520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.428056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.428544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.554725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:21.555247 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:21.557680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:21.561513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.561513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.561957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.562664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.563119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.563536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.565847 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3f4120ec-a106-4d40-b13e-4096c3c0d8d7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.153560 Oct 23 20:08:21.566439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 240/500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:21 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:21.692423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:21.701351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f5aa9d69-09c7-45e3-9875-1b39fda25aa7 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1595 microversion: 2.1 time: 0.151114 Oct 23 20:08:21.701916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 261/501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:21 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:21.760557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:21.761580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:21.768051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.768532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.768961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.769648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:21.770106 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:21.770556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:21.966699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:21.980231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-30690e9f-52a4-4dde-a640-a85120c9c121 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.222803 Oct 23 20:08:21.987371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 241/502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:21 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:22.000226 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:22.001467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:22.011908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:22.012794 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:22.013582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:22.015158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:22.016191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:22.017212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:22.107516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:22.116083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1791c89f-d603-4c86-9839-7d57ac77a4b8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1210 microversion: 2.1 time: 0.123164 Oct 23 20:08:22.116876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 262/503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:21 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:22.589767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:22.590400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:22.596866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:22.597347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:22.597770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:22.598482 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:22.599558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:22.599977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:22.822018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:22.830602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-55e80040-9ca1-4648-a210-a40e5e8a33f2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.245041 Oct 23 20:08:22.831174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 242/504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:22 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:23.004026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:23.004844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:23.011443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.011929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.012359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:23.013057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.013667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.014358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:23.141421 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:23.142073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:23.148980 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.149733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.150168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:23.150901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.151359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.151785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:23.451105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:23.460025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-15705dbd-9a38-47de-bac9-144eafda09c6 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1210 microversion: 2.1 time: 0.322850 Oct 23 20:08:23.474382 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 243/505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:23 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1210 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:23.604030 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:23.611588 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a1184154-4cf6-49b5-8fb3-1c5c139f5358 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1313 microversion: 2.1 time: 0.611426 Oct 23 20:08:23.612159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 263/506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:22 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:23.853263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:23.853900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:23.860327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.860810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.861241 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:23.861924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:23.862398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:23.862833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.016931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:24.035022 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:24.036022 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:24.037070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.053605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:24.058649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] Creating event network-changed:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:08:24.064710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-56e16cdc-18d1-4b91-9bdb-b2fc6b896ca7 req-cfdca973-1226-4118-9bde-60ab6721b31f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051575 Oct 23 20:08:24.065720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 264/507] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:24.067268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-39f2b371-0c12-40c8-b453-ca6e149a0604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.216244 Oct 23 20:08:24.070464 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 244/508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:23 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:24.484545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:24.485918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:24.495114 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:24.496054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:24.496808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.498275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:24.499358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:24.500044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.638058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:24.638835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:24.649570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:24.651761 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:24.652563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:24.653549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.654666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:24.655692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:24.656632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:24.660468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2f525696-b681-42c0-ab46-67eb46ae3fa7 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1266 microversion: 2.1 time: 0.180881 Oct 23 20:08:24.675275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 265/509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:24 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:24.981019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:24.994842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c9ab4094-a5dd-42f3-ac1e-40cf56967dd4 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1497 microversion: 2.1 time: 0.362043 Oct 23 20:08:24.995496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 245/510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:24 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1497 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:25.096097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:25.096745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.103384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.103885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.104319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.105017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.105465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.110858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.440819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:25.469418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-91389633-0f75-4a40-894e-1521ab1894bc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1501 microversion: 2.1 time: 0.380783 Oct 23 20:08:25.470331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 266/511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:25 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:25.497364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1230454-aa04-4c7d-aaed-3bc00dd7695c"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:25.512931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.537215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.537664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.538108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.538830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.539283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.540425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.591485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] HTTP exception thrown: Cannot 'attach_volume' instance df8837d8-442b-4b75-b896-e07e4a04391f while it is in vm_state rescued Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Request method failure captured: Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/os-volume_attachments HTTP/1.1 Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 74 Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6GJSHS7PE_rhsH1AThlFNasoBL6ha9FEFafOtUV-zPBMkfti6CC_gtYVpttrReSsvhSG8Sv9lljUzzUEwxH2wrwtwzXMo3KdgVuHRXo1JEnupgg36Fgbv-_Qu2ZXTqiTCBzlv-Ax6p7bQdTfH3NOqRJIjQVlLCQvZ6gpdgW4Tzmkc Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:08:25.593757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41c21bcf4ca457391486c08565b2aae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}] Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 4b6a101d23df4b62ba7e0c35d28d2a3c Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {"volumeAttachment": {"volumeId": "e1230454-aa04-4c7d-aaed-3bc00dd7695c"}} Oct 23 20:08:25.595313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Cannot 'attach_volume' instance df8837d8-442b-4b75-b896-e07e4a04391f while it is in vm_state rescued Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'server_id': 'df8837d8-442b-4b75-b896-e07e4a04391f', 'body': {'volumeAttachment': {'volumeId': 'e1230454-aa04-4c7d-aaed-3bc00dd7695c'}}} Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df8837d8-442b-4b75-b896-e07e4a04391f in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:08:25.596189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance df8837d8-442b-4b75-b896-e07e4a04391f while it is in vm_state rescued Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:25.597497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:25.600267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:08:25.600267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:08:25.600267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance df8837d8-442b-4b75-b896-e07e4a04391f while it is in vm_state rescued Oct 23 20:08:25.600267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:25.601329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Returning 409 to user: Cannot 'attach_volume' instance df8837d8-442b-4b75-b896-e07e4a04391f while it is in vm_state rescued {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:08:25.602374 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a482af00-e7b3-4d0b-aae0-e5a4a5abc7b3 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109623 Oct 23 20:08:25.616595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 246/512] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:08:25 2022] POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 20:08:25.618207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:25.619011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.639099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.648252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.650859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.653151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.655458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.658093 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.686030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:25.686676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.698999 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.699680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.700131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.700843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.701300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.701716 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.847063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-44195faf-f458-44e5-9aab-c8cde6c33762 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/action" status: 202 len: 0 microversion: 2.1 time: 0.233769 Oct 23 20:08:25.858751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 267/513] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:08:25 2022] POST /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:08:25.869617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1713642150"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:25.870859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.877290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:25.879670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.882346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.883170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.884285 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.885268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.885700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.904185 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-67855988-5a23-4b31-a133-c65ef7f3ad1d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1284 microversion: 2.1 time: 0.223718 Oct 23 20:08:25.905270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 247/514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:25 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:25.910188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:25.911031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:25.919037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.919892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.920394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.921260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:25.921871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:25.922327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:25.952032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:08:26.062945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2af05b55-3f22-4051-a517-b790abad36d2 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 204 len: 0 microversion: 2.1 time: 0.155031 Oct 23 20:08:26.064469 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 248/515] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:08:25 2022] DELETE /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:08:26.074434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.network.security_group_api [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Adding security group cbda9d00-e98a-43c2-9d1f-4f2b50230b94 to port 5baa163f-fb98-46dd-88e4-27b50776e2f7 Oct 23 20:08:26.075023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:26.076580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:26.091739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.092655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.093150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.093921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.095035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.095709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.374317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:26.389566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-84d44f80-e4eb-4e4e-ab8a-6cd5f5285184 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1509 microversion: 2.1 time: 0.323380 Oct 23 20:08:26.390531 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 249/516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:26 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:26.397568 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:26.398475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:26.404425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.405003 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.405530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.406332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.407004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.407511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.612809 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:26.627054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ecb6ab86-5027-461f-93fb-87f23bbb7cb2 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action" status: 202 len: 0 microversion: 2.1 time: 0.765494 Oct 23 20:08:26.629086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 268/517] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:08:25 2022] POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:08:26.637516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:26.650585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.651404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.651996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.653281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-481ef1d7-bf0a-40d1-ba1f-8f7f6e3bd191 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1503 microversion: 2.1 time: 0.259645 Oct 23 20:08:26.655270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 250/518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:26 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:26.656921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:26.675040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:26.675690 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:26.687440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] Creating event network-changed:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:08:26.693798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-984ff506-1f85-4c04-a1c1-e083e08f638b req-59e82618-3766-407e-acd6-219fb04eeed5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059811 Oct 23 20:08:26.699313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 269/519] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:08:26.721046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.722733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.723351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.725190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.725798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.727355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.909913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:26.919850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b78026d9-adbb-40f2-ba8c-aa9245a6c3c3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1761 microversion: 2.1 time: 0.261786 Oct 23 20:08:26.920684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 251/520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:26 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1761 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:26.939348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:26.943436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:26.950924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.951419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.951853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:26.952578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:26.953036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:26.953457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:27.100945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:27.108741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-545145d1-3d5b-4742-a13c-f7fe5d1b56db tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.183699 Oct 23 20:08:27.109318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 270/521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:26 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:27.413114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:27.413726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:27.419715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:27.420200 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:27.420636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:27.421324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:27.421777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:27.422202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:27.554301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:27.561879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2264b341-e92c-48ff-add5-b17064e76960 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1509 microversion: 2.1 time: 0.152663 Oct 23 20:08:27.562476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 252/522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:27 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:27.680809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:27.682154 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:27.689061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:27.689581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:27.690010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:27.690726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:27.691343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:27.691749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:27.847139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:27.855152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-75a4b8d4-ad5f-4893-a759-7fe4f7426a88 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1503 microversion: 2.1 time: 0.178296 Oct 23 20:08:27.855747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 271/523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:27 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:28.131980 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:28.133256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:28.141717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.142544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.143215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.144143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.144807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.145580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.514967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:28.528190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a038f598-24a2-456c-a772-9f530de69da4 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.399937 Oct 23 20:08:28.528775 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 253/524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:28 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:28.587597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:28.590230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:28.599879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.601508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.602575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.603546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.604246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.604893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.878850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:28.879389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:28.886324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.886819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.887252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.888029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:28.888671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:28.889377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:28.893879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:29.290837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:29.292313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:29.298633 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9e4f959e-9943-4f70-b8dc-45d47e2a2605 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1509 microversion: 2.1 time: 0.717080 Oct 23 20:08:29.299202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 272/525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:28 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1509 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:29.300827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d8eec475-e867-4ce5-811f-95568d23719f tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1461 microversion: 2.1 time: 0.426021 Oct 23 20:08:29.301588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 254/526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:28 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1461 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:29.306691 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24a9adf-3c03-464e-b2f7-581ac6386942", "tag": "26a198f5-8e84-4a11-b41d-8c527cb13bb1"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:29.314868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e47422-88b9-49c7-9046-4b4627d1b2e4", "name": "network-vif-deleted", "tag": "3c035e36-fdd3-4b20-82eb-f0cefea6a5fb"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:29.317104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:29.317641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:29.318660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:29.326197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:29.326867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:29.327300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:29.330689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] Creating event network-changed:26a198f5-8e84-4a11-b41d-8c527cb13bb1 for instance a24a9adf-3c03-464e-b2f7-581ac6386942 on hv-cinder-86243 Oct 23 20:08:29.341392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] Creating event network-vif-deleted:3c035e36-fdd3-4b20-82eb-f0cefea6a5fb for instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 on hv-cinder-86243 Oct 23 20:08:29.345817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-61433720-21ac-44f6-a70f-aaba3d83c23d req-b51ee6b7-6c1c-4efd-8ebb-c90c3cab9448 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042333 Oct 23 20:08:29.346549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 255/527] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:29.347243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-7769e78e-b8f9-46d6-8adb-af759ff4e287 req-a369286a-1e4d-4212-8643-9039dcc58beb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046420 Oct 23 20:08:29.348068 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 273/528] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:29.613528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:29.614232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:29.620307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:29.620782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:29.621211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:29.621890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:29.622389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:29.622811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:29.757760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:29.765534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-308d126a-9245-41b2-b6c9-a4a4d1ece41d tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.156209 Oct 23 20:08:29.766101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 256/529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:29 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:30.337824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:30.338556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:30.344603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:30.344814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.345208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:30.345322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.345722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.346443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.346896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.347318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.351898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.352371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.352914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.353703 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.354156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.354691 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.389107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.389598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.390072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.390570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 85e47422-88b9-49c7-9046-4b4627d1b2e4 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:30.451539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:30.459882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c4da5243-c42b-4880-8587-e6b239e6722b tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1303 microversion: 2.1 time: 0.118945 Oct 23 20:08:30.460470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 257/530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:30 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:30.509548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:30.517165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2268fb52-d1d0-48ef-ad3b-b6011c3c632d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1509 microversion: 2.1 time: 0.183579 Oct 23 20:08:30.517725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 274/531] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:30 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:30.790502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:30.790502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:30.792539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:30.797933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.798448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.798888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.799619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:30.800073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:30.800499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:30.823155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:30.928491 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:30.936190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a14ff549-1e74-4a37-8be2-55730839908a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.151021 Oct 23 20:08:30.936755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 258/532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:30 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:31.485538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:31.486160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:31.489446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:31.493567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.494060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.494569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.495338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.495802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.496219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.529572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.530060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.530521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.530965 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 85e47422-88b9-49c7-9046-4b4627d1b2e4 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:31.540448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:31.541054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:31.547432 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.547845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.548273 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.548953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.549401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.549814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.575547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:31.583779 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6c10863b-3e57-44fb-af5e-b1897bd7d989 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1303 microversion: 2.1 time: 0.102786 Oct 23 20:08:31.584353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 275/533] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:31 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:31.682339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:31.689937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-98e2c27d-2162-46c3-9699-d1fca10f4fd0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1515 microversion: 2.1 time: 0.153900 Oct 23 20:08:31.690537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 259/534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:31 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:31.963353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:31.964477 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:31.976075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.978965 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.979617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:31.980725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:31.981383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:31.983140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:32.139094 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:32.146543 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-42d4f994-a8eb-4c2a-9231-ee59cfcbdeb0 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.190935 Oct 23 20:08:32.147104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 276/535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:31 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:32.608594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:32.609131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:32.616265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:32.616735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:32.617160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:32.617863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:32.618343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:32.618761 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:32.648901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:32.649422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:32.649855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:32.650328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 85e47422-88b9-49c7-9046-4b4627d1b2e4 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:32.694313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:32.702122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-09a25036-c1fd-43c4-baf2-18f50b855d0a tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1303 microversion: 2.1 time: 0.097475 Oct 23 20:08:32.702718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 260/536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:32 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:33.065985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-49149a93-5f10-4319-bd7c-5b321aa48346 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: .version_select at 0x7f64f059a670>, body: {"keypair": {"name": "tempest-keypair-472134453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaWWYbOLzUsZzyD15zXMXBAhoPTXgiZjNcctdGaJJXzSllvKTkXm6AqJNj1EPnlSt41D5D/bBIRt8FxdquIinBIMpiS3SHLVfdSTbTKGY2CgZGgwvK3pW5NoKAAx92LOQ=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:33.081918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-49149a93-5f10-4319-bd7c-5b321aa48346 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for project e41c21bcf4ca457391486c08565b2aae. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:08:33.085893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-49149a93-5f10-4319-bd7c-5b321aa48346 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for user 4b6a101d23df4b62ba7e0c35d28d2a3c and project e41c21bcf4ca457391486c08565b2aae. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:08:33.110541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-49149a93-5f10-4319-bd7c-5b321aa48346 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048259 Oct 23 20:08:33.111131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 277/537] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:08:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:33.169220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:33.170012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:33.175888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:33.176378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:33.176861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:33.177557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:33.178019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:33.178478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:33.348563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:33.356225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e76d440b-5b0d-4883-a759-e315973e261b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.191022 Oct 23 20:08:33.366274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 261/538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:33 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:33.724932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:33.725561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:33.731453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:33.731928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:33.732348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:33.733023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:33.733467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:33.733881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:33.766238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:33.766741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:33.767217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:33.767605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 85e47422-88b9-49c7-9046-4b4627d1b2e4 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:33.811240 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:33.820463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c54a04b9-fe19-4113-a4ac-77c3ddfc14a5 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1303 microversion: 2.1 time: 0.099036 Oct 23 20:08:33.820973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 278/539] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:33 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:34.380898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:34.381535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:34.388048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.388538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.388966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:34.389658 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.390114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.390573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:34.470756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1953457982", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fadb6cf-3557-4130-bf6c-5eb0e0fb1ad2"}], "security_groups": [{"name": "tempest-securitygroup--897501864"}], "key_name": "tempest-keypair-472134453", "user_data": "}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:34.558949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:34.566402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e9d4654f-3cf8-40d8-9af6-8864409b0641 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.189563 Oct 23 20:08:34.566968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 262/540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:34 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:34.587249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] validate_networks() for [('4fadb6cf-3557-4130-bf6c-5eb0e0fb1ad2', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:08:34.844080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:34.844633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:34.851021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.851770 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.852522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:34.853427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.854050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.854913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:34.887805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.888281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.888707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:34.889139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lazy-loading 'fault' on Instance uuid 85e47422-88b9-49c7-9046-4b4627d1b2e4 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:34.954929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48be37e3311a4d6c968b135f8e5ee536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b77aad0457485693b9a43b85506915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:34.963028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7c5b565a-3609-4bbb-be72-9219b356b029 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 200 len: 1303 microversion: 2.1 time: 0.123019 Oct 23 20:08:34.963601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 263/541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:34 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:34.988181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:08:34.988599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:08:34.989062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:08:34.989542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:08:34.989973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:08:34.998566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:34.999038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:34.999465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:35.000204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:35.000651 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:35.001067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:35.017839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:08:35.022414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Getting quotas for user 4b6a101d23df4b62ba7e0c35d28d2a3c and project e41c21bcf4ca457391486c08565b2aae. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:08:35.033637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:08:35.035999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:08:35.085118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a5f55dbb-90eb-49bf-b5c9-d352bc50a156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.623076 Oct 23 20:08:35.086446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 279/542] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:08:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (3 switches on core 0) Oct 23 20:08:35.097619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-913204ca-2963-4900-8385-6808c872b190 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:35.098486 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-913204ca-2963-4900-8385-6808c872b190 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:35.166591 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-913204ca-2963-4900-8385-6808c872b190 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:35.178599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-913204ca-2963-4900-8385-6808c872b190 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1245 microversion: 2.1 time: 0.084944 Oct 23 20:08:35.180892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 264/543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:35 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:35.589749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:35.591057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:35.599947 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:35.607276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:35.608133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:35.609520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:35.609992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:35.610466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:35.752835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:35.760718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c970cb86-d21a-418f-ac11-c6343c82b79b tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.175321 Oct 23 20:08:35.774437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 280/544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:35 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:35.987107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:35.987924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] [instance: 85e47422-88b9-49c7-9046-4b4627d1b2e4] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:35.994523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:35.995016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:35.995452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:35.996146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:35.996602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:35.997027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:36.011393 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] HTTP exception thrown: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Request method failure captured: Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 HTTP/1.1 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ7dIB_ZgzAEYXXX1-2bFY9XvRVj4b7JA8Pg-OkIRTLVuzn0weYzbF4hlViJG5JMULO1taKPYNXTkcdSfT7XxE6Ag8Wk6BMBfumIxTWvbJO4Vk5L0Mf9qZRA8mneF5l_-cf8iOlaWH2LfK8jk0QRtQTiGgbPXqgSYPseSSJ-xMb4h8I Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 46b77aad0457485693b9a43b85506915 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:08:36.013025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46b77aad0457485693b9a43b85506915", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46b77aad0457485693b9a43b85506915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46b77aad0457485693b9a43b85506915"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46b77aad0457485693b9a43b85506915"}]}] Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 46b77aad0457485693b9a43b85506915 Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesActionsTest-1876259199 Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesActionsTest-1876259199-project Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 48be37e3311a4d6c968b135f8e5ee536 Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesActionsTest-1876259199-project Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. Oct 23 20:08:36.014510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '85e47422-88b9-49c7-9046-4b4627d1b2e4'} Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:08:36.015250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. Oct 23 20:08:36.016642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:08:36.017776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] Returning 404 to user: Instance 85e47422-88b9-49c7-9046-4b4627d1b2e4 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:08:36.017776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0e959254-3850-4550-823f-f275f99c4a41 tempest-VolumesActionsTest-1876259199 tempest-VolumesActionsTest-1876259199-project] 10.222.0.13 "GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4" status: 404 len: 111 microversion: 2.1 time: 0.031213 Oct 23 20:08:36.017776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 265/545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:35 2022] GET /compute/v2.1/servers/85e47422-88b9-49c7-9046-4b4627d1b2e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:08:36.201032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:36.201636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:36.207534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:36.208676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:36.209003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:36.209674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:36.210122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:36.210570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:36.275977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:36.287088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-75d53ea4-beec-4049-a2be-1ced51ce8a1f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1297 microversion: 2.1 time: 0.087082 Oct 23 20:08:36.287875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 281/546] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:36 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:36.784547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:36.785567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:36.792277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:36.793088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:36.793529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:36.798622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:36.799150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:36.799773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:36.941139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:36.949692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e0501558-b558-4aa5-9420-f94c7b37156f tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.169075 Oct 23 20:08:36.950273 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 266/547] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:36 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:37.309270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:37.310680 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:37.317830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:37.318589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:37.319179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:37.320107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:37.320992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:37.321410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:37.467036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:37.476063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5ff651aa-2f77-4853-b0d4-db15dd14fc9e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.170827 Oct 23 20:08:37.491462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 282/548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:37 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:37.689530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24a9adf-3c03-464e-b2f7-581ac6386942", "name": "network-vif-plugged", "status": "completed", "tag": "26a198f5-8e84-4a11-b41d-8c527cb13bb1"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:37.702697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:37.703545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:37.704189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:37.717231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] Creating event network-vif-plugged:26a198f5-8e84-4a11-b41d-8c527cb13bb1 for instance a24a9adf-3c03-464e-b2f7-581ac6386942 on hv-cinder-86243 Oct 23 20:08:37.722632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-3b1d14b7-00ce-423e-ac3c-48bf9df560af req-e0a44c53-32ff-4de5-9b3b-76c6810322ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036784 Oct 23 20:08:37.724896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 267/549] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:37.972106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:37.972707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:37.979000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:37.979490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:37.980503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:37.981210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:37.981670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:37.982140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:38.113447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:38.121939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5d47841b-473d-462b-b6b4-3000b763f8f3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.153913 Oct 23 20:08:38.122635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 283/550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:37 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:38.137859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:38.142879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:38.148815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:38.149360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:38.149847 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:38.161447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] Creating event network-changed:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:08:38.166748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-276a8649-6f68-4f48-ba00-9076f84b1159 req-b4a768d9-d0a4-4b2e-915e-3e07d99912a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032753 Oct 23 20:08:38.167426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 268/551] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:08:38.498745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:38.499357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:38.505233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:38.505699 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:38.506127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:38.506833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:38.507284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:38.507730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:38.637899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:38.645377 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bac4b2ff-3c58-4254-a168-0e357be5072b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.150421 Oct 23 20:08:38.646131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 284/552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:38 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:39.145870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:39.146536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:39.152806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:39.153285 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:39.153714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:39.154455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:39.154918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:39.155337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:39.280831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:39.288903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2f7c9d5c-069e-42ec-aab0-f716e384a955 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.147789 Oct 23 20:08:39.289458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 269/553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:39 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:39.668268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:39.668875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:39.674989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:39.675472 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:39.675903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:39.676582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:39.677032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:39.677446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:39.807188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:39.814654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d422dde9-f257-4caa-affe-fe53a116e156 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.150224 Oct 23 20:08:39.815208 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 285/554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:39 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:40.312257 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:40.312801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:40.319822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:40.320573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:40.321010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:40.321706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:40.322161 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:40.322611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:40.447057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:40.454696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1b2ad871-2509-4c99-acd2-a5589eee08f1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.146337 Oct 23 20:08:40.455255 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 270/555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:40 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:40.837397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:40.837998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:40.843839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:40.844317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:40.844744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:40.845420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:40.845870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:40.846302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:40.976287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:40.983859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9b6c5465-1662-4a9a-b1af-d20cd6201ba0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.150345 Oct 23 20:08:40.984358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 286/556] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:40 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:41.477064 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:41.477669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:41.484338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:41.484813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:41.485239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:41.485915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:41.486416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:41.486831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:41.613597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:41.621196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6a29a829-528f-4f1d-94ba-9f04d7ee22c5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.148038 Oct 23 20:08:41.621750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 271/557] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:41 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:42.008380 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:42.008997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:42.010880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:42.016067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:42.016586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:42.017032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:42.017728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:42.018181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:42.018640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:42.148104 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:42.155737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ea109f7f-358e-4030-98a4-9768aaf4c97a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.151841 Oct 23 20:08:42.156303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 287/558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:42 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:42.643366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:42.643981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:42.650891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:42.651376 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:42.651814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:42.652504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:42.652961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:42.653389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:42.783806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:42.791849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-43709f75-788d-4540-bc1f-db6541d46cf1 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.152356 Oct 23 20:08:42.792410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 272/559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:42 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:43.178581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:43.179184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:43.185048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:43.185525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:43.185977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:43.186682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:43.187127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:43.187545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:43.191430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:43.314870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:43.323184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-13a216da-c788-4153-ab85-440d895da057 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.148537 Oct 23 20:08:43.323742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 288/560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:43 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:43.814925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:43.815562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:43.817994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 20:08:43.818127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Sun Oct 23 20:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 (ip 10.222.0.13) !!! Oct 23 20:08:43.826576 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:43.827087 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:43.827620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:43.828402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:43.828960 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:43.829395 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:43.847530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:43.983593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:43.992050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e4af6ac8-5f79-481b-983b-cb83f503297e tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.181026 Oct 23 20:08:44.006641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 273/561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:43 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:44.348013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:44.350098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:44.359444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:44.360481 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:44.361156 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:44.362083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:44.362677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:44.363194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:44.516589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:44.527281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f3d3e871-b163-4994-83b9-02a9710446e0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.185167 Oct 23 20:08:44.528471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 289/562] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:44 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:45.023070 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:45.026165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:45.037145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:45.039060 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:45.039768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:45.046778 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:45.047330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:45.047906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:45.171470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:45.201678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:45.212153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3886cf84-3f62-4809-8026-a23a8dd1e8d8 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.199003 Oct 23 20:08:45.213139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 274/563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:45 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:45.551253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:45.552436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:45.554321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:45.554976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=10 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:45.561878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:45.562392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:45.563043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:45.563745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:45.564200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:45.564620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:45.701953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:45.710294 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dfc9a7f4-fee9-4958-8b44-cdb4c55cdf73 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.163208 Oct 23 20:08:45.711087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 290/564] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:45 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:46.235462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:46.236092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:46.242942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:46.243594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:46.244318 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:46.245498 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:46.246180 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:46.246645 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:46.393663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:46.408079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e42ad35a-e50c-40d4-a510-0749ce557bc5 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.176486 Oct 23 20:08:46.416286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 275/565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:46 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:46.740932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:46.741539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:46.753279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:46.753770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:46.758184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:46.758988 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:46.759463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:46.759895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:46.909165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:46.929150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f5f4ae8d-4ad0-47f4-adcb-c9f1e5a7f60b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.199426 Oct 23 20:08:46.929749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 291/566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:46 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:47.432238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:47.433023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:47.440513 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:47.441088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:47.441787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:47.443083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:47.443767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:47.444260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:47.601701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:47.609473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0917852b-57de-4fdc-b24c-c00bc8cd18e3 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.181705 Oct 23 20:08:47.610046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 276/567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:47 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:47.956327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:47.957086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:47.965218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:47.965709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:47.966370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:47.967254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:47.967865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:47.968442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:48.163649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:48.176771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6a11e291-4779-4643-939d-ff2e3218e7fb tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.227656 Oct 23 20:08:48.177837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 292/568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:47 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:48.641900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:48.642525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:48.654276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:48.654893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:48.655370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:48.656155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:48.656816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:48.657243 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:48.796894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:48.805831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0278aaeb-24e1-4164-bb0a-2b0eca4c19ab tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1314 microversion: 2.1 time: 0.167625 Oct 23 20:08:48.806748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 277/569] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:48 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:49.206789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:49.209023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:49.222286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:49.222286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:49.222567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:49.223585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:49.224770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:49.225341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:49.422687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:49.431466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8160692d-38fd-42b2-86d5-64047d1fdde8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.229530 Oct 23 20:08:49.432324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 293/570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:49 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:49.833292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:49.833901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:49.840353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:49.840839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:49.841336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:49.842032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:49.842519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:49.842930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.036791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:50.053932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e0184033-4889-443c-b9dd-baefb823fb9a tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1463 microversion: 2.1 time: 0.224428 Oct 23 20:08:50.054904 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 278/571] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:49 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:50.103569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:50.104070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:50.110593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.111081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.111526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.112204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.112653 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.113071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.141761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:08:50.240834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ef821f4d-75e8-41ea-95bf-f66fba29ec31 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 204 len: 0 microversion: 2.1 time: 0.140545 Oct 23 20:08:50.242522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 294/572] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:08:50 2022] DELETE /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:08:50.251794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:50.252776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:50.259274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.259940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.260494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.261335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.261894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.262463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.413743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:50.422718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-35d35701-16a7-4433-9f89-c27202dac1b2 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1469 microversion: 2.1 time: 0.174776 Oct 23 20:08:50.423387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 279/573] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:50 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:08:50.456564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:50.457333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:50.464021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.464512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.464944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.465637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.466095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.466549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.619608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:50.628227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0a5c9926-1625-4885-85be-71438998383e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.175787 Oct 23 20:08:50.647942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 295/574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:50 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:50.753452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "name": "network-vif-plugged", "status": "completed", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:50.773133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:50.773623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:50.781827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:50.804368 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] Creating event network-vif-plugged:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:08:50.811204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-fcef8d38-e6de-4405-88e4-9a3ccbc83c08 req-5aea7c72-9ba5-4888-8442-13eae1add2a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061593 Oct 23 20:08:50.812318 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 280/575] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:51.448904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:51.450235 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:51.457787 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:51.458646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:51.459305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:51.460855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:51.461548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:51.462494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:51.638450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:51.647959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8656c825-9a04-4ad6-ac92-99e1fdb9b298 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1469 microversion: 2.1 time: 0.204091 Oct 23 20:08:51.658314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 296/576] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:51 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:51.668632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:51.668632 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:51.677620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:51.678584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:51.678584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:51.679270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:51.679753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:51.680183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:51.838968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:51.847758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f169ab56-a6c6-4b7b-975e-fd917295ca53 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.186567 Oct 23 20:08:51.849166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 281/577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:51 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:52.673095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:52.673710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:52.680879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:52.681369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:52.681803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:52.682523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:52.683046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:52.683405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:52.836267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:52.843973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2f3e4734-e330-4bf8-9c4f-c1d5699422cf tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1469 microversion: 2.1 time: 0.174743 Oct 23 20:08:52.844542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 297/578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:52 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:52.871361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:52.871969 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:52.878765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:52.879492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:52.880121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:52.883634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:52.884157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:52.884592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:53.048762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:53.058933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-daaa56c1-1ea4-48c2-9fb0-fc4c615ced1a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1370 microversion: 2.1 time: 0.191254 Oct 23 20:08:53.060182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 282/579] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:52 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:53.854929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24a9adf-3c03-464e-b2f7-581ac6386942", "name": "network-vif-deleted", "tag": "26a198f5-8e84-4a11-b41d-8c527cb13bb1"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:53.867286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:53.868238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:53.868884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:53.870119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:53.870761 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:53.885133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:53.885777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:53.886040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:53.887144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:53.887704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:53.888155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:53.889009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] Creating event network-vif-deleted:26a198f5-8e84-4a11-b41d-8c527cb13bb1 for instance a24a9adf-3c03-464e-b2f7-581ac6386942 on hv-cinder-86243 Oct 23 20:08:53.896917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-9e30dbf8-0475-4851-8c24-2530f377280f req-eeeb070d-3fb2-4b51-a8b3-7ad7511e6800 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045356 Oct 23 20:08:53.898443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 298/580] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:53.981893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:53.992328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5e3f2d85-75ad-43e5-9690-65aff874dc22 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1427 microversion: 2.1 time: 0.128224 Oct 23 20:08:53.993322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 283/581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:53 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:54.085416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:54.086480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:54.093865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:54.094465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:54.094905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:54.095599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:54.096061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:54.096534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:54.254141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:54.261753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0b75a204-ecfd-4636-b8ad-a05d6acbd8ff tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1564 microversion: 2.1 time: 0.180525 Oct 23 20:08:54.262413 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 299/582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:54 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:54.284503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:54.285003 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:54.291601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:54.292086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:54.292524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:54.293319 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:54.293779 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:54.294208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:54.386039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-56548ad7-e43a-4ba6-866b-1d890b6abba6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105412 Oct 23 20:08:54.387746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 284/583] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:08:54 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:55.017593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:55.019287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:55.030880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:55.031570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:55.032155 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:55.033013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:55.033622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:55.034473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:55.073255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:55.073946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:55.074651 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:55.075246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lazy-loading 'fault' on Instance uuid a24a9adf-3c03-464e-b2f7-581ac6386942 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:08:55.158634 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cf226192c94300bafdd3bac13ab8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31769b5e4c4b2e9680f86cd820784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:08:55.169210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2774c0e5-b1d3-4f17-9e95-2cce8c23bc33 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 200 len: 1304 microversion: 2.1 time: 0.155555 Oct 23 20:08:55.170469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 300/584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:55 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:08:56.137465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:08:56.148493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:56.148975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:56.149404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:56.164390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] Creating event network-changed:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:08:56.169593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-567b3398-fcbe-4769-93e2-9c3ce03c78a4 req-9af464c3-7cc3-431f-aa56-d93885fb305f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035693 Oct 23 20:08:56.174139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 285/585] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:08:56.199279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:08:56.200333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] [instance: a24a9adf-3c03-464e-b2f7-581ac6386942] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:08:56.215305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:56.216319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:56.217004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:56.217918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:08:56.218767 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:08:56.219706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:08:56.244010 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] HTTP exception thrown: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Request method failure captured: Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 HTTP/1.1 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ8uNatswDlMwHEfzYdex6whXzwcSXacLM8If0P_-TvNXo1PO4or3vBc99TH064xImn1hfY5p3G74awk_c4_UKr8bXOZPS6m7A_ASOKPRCR7vu3UIgE44GMZvFyy7cxlsa-GvChXn6zvjixJdmRiEl1J3qk1BAxZrUsJy1GNj8P1HM0 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: ae31769b5e4c4b2e9680f86cd820784f Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesNegativeTest-1631756454 Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:08:56.247687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ae31769b5e4c4b2e9680f86cd820784f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ae31769b5e4c4b2e9680f86cd820784f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ae31769b5e4c4b2e9680f86cd820784f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ae31769b5e4c4b2e9680f86cd820784f"}]}] Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesNegativeTest-1631756454 Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: ae31769b5e4c4b2e9680f86cd820784f Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesNegativeTest-1631756454 Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesNegativeTest-1631756454-project Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: c9cf226192c94300bafdd3bac13ab8bc Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesNegativeTest-1631756454-project Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. Oct 23 20:08:56.249799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'a24a9adf-3c03-464e-b2f7-581ac6386942'} Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:08:56.250852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. Oct 23 20:08:56.252169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:08:56.259342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] Returning 404 to user: Instance a24a9adf-3c03-464e-b2f7-581ac6386942 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:08:56.260824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e43e82f8-bce7-4d3f-90aa-b3d0d381d712 tempest-VolumesNegativeTest-1631756454 tempest-VolumesNegativeTest-1631756454-project] 10.222.0.13 "GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942" status: 404 len: 111 microversion: 2.1 time: 0.069159 Oct 23 20:08:56.261703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 301/586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:08:56 2022] GET /compute/v2.1/servers/a24a9adf-3c03-464e-b2f7-581ac6386942 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:09:11.045992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=35 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:11.047383 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=64 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:11.244242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e1a7e09a-0827-480e-9ca8-45343328d662 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Action: 'create', calling method: .version_select at 0x7f64f02b1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1509594046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6yypFEoSSfGltUig8YdZypKwpluhjBsrBHCxfOXreNaxm8+Jqu3tfUciw3chGZ2DnWthKZDWFbxyGrNEK7nWQNtdsxDNLJmZ5GhGfEtinosttRZ9QhR1I/V2yQNiyA8A=="}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:11.260451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-e1a7e09a-0827-480e-9ca8-45343328d662 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Getting quotas for project f84aaa230cf14fd2b47b2076e43fcb73. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:09:11.264709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-e1a7e09a-0827-480e-9ca8-45343328d662 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Getting quotas for user 21fac7ecf4f2435483df150292a0052b and project f84aaa230cf14fd2b47b2076e43fcb73. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:09:11.291997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e1a7e09a-0827-480e-9ca8-45343328d662 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.247665 Oct 23 20:09:11.292589 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 286/587] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:09:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:11.911438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:11.912065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:11.921199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:11.922045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:11.929277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:11.929681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:11.930120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:11.930872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:11.931322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:11.931733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:11.960570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5b5bc80d-cf7f-4436-afb1-4b703c9822c8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/ips" status: 200 len: 146 microversion: 2.1 time: 0.054459 Oct 23 20:09:11.961215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 302/588] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:09:11 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:15.923757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e29f96-13e2-4da8-8884-e447d960bbab"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:15.926821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:15.933215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:15.933698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:15.934127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:15.934836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:15.935288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:15.935706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:16.187542 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-86d965e3-5438-40f5-95f8-8577a63bed03 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267603 Oct 23 20:09:16.193169 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 287/589] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:09:15 2022] POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:18.296410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:18.296924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:18.303309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:18.303790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:18.304219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:18.304899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:18.305356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:18.305849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:18.330176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a364bf97-cd1d-4278-aaf5-0091c16253b0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/ips" status: 200 len: 152 microversion: 2.20 time: 0.037670 Oct 23 20:09:18.330778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 303/590] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 23 20:09:18 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:09:20.491661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:20.492295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:20.498428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:20.498903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:20.499331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:20.500007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:20.500453 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:20.501152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:20.525866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lazy-loading 'flavor' on Instance uuid 4abcffff-127a-4a75-84a5-19e12536b4de {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:09:20.719452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5a2ed3ae-fe06-46c7-bcdc-fada473b1656 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/action" status: 202 len: 0 microversion: 2.20 time: 0.232444 Oct 23 20:09:20.720068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 288/591] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 20:09:20 2022] POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 20:09:20.728831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:20.729431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:20.735527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:20.736114 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:20.736669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:20.737758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:20.738106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:20.738594 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:20.872916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:20.882547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:20.883997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:20.885190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5a2d0039-85f8-4566-bc39-3779b1050251 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.160167 Oct 23 20:09:20.885755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 304/592] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:20 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:21.909014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:21.913738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:21.914470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:21.921815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:21.922331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:21.922765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:21.923457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:21.923909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:21.924332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:22.056819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:22.064980 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:22.066446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:22.067599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a007de3e-a2b2-4517-bc98-f6fb21844977 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.160102 Oct 23 20:09:22.068162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 289/593] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:21 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:23.092889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:23.093519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:23.100105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:23.100583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:23.101011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:23.101681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:23.102136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:23.102590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:23.240223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:23.248522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:23.249944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:23.251103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-393895f6-9dd2-4cf0-a97d-fd149ab10b66 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.162099 Oct 23 20:09:23.251650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 305/594] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:23 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:23.737644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:23.746410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:23.747145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:23.748071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:23.809299 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Going to try to stop instance {{(pid=118866) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 20:09:23.855526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0fc9592f-0a09-469b-8cc9-de66c4315fe3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action" status: 202 len: 0 microversion: 2.1 time: 0.122059 Oct 23 20:09:23.856129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 290/595] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:09:23 2022] POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:09:23.864160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:23.864756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:23.870601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:23.871074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:23.871502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:23.872168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:23.872631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:23.873051 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:24.007188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:24.015344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-af596779-8198-4701-bb27-86a01c8ba902 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.155028 Oct 23 20:09:24.015906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 306/596] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:23 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:24.277330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:24.277975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:24.284181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:24.284858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:24.286029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:24.287129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:24.287590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:24.288213 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:24.428295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:24.435067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:24.436505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:24.437668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8715c744-57da-4157-882d-aa3908c38cc1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.164742 Oct 23 20:09:24.438219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 291/597] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:24 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:25.042461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:25.042461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:25.048317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:25.048809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:25.049243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:25.049931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:25.050426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:25.050874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:25.177665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:25.185831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-dd1c4778-fa61-4ead-8582-c84548d21ceb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.149181 Oct 23 20:09:25.186416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 307/598] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:25 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:25.463737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:25.464336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:25.471197 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:25.471681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:25.472107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:25.472784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:25.473285 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:25.473706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:25.604147 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:25.612090 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:25.613512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:25.614668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ac751a71-6c4d-4ae7-bbfd-2bdb139543a2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.154752 Oct 23 20:09:25.615226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 292/599] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:25 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:26.209836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:26.210411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:26.216283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:26.216766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:26.217199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:26.217878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:26.218367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:26.218793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:26.344126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:26.352431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-84de103c-d46b-481d-ba1c-9d204dfdd2c2 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.147170 Oct 23 20:09:26.352994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 308/600] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:26 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:26.640617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:26.641280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:26.648412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:26.648906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:26.649341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:26.650054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:26.650538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:26.650967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:26.782800 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:26.791064 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:26.792605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:26.793764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fad4c8be-7254-4999-a77f-317a49363b99 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.157117 Oct 23 20:09:26.794377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 293/601] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:26 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:27.375750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:27.376358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:27.382393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:27.382876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:27.383308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:27.383985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:27.384436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:27.384855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:27.510038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:27.519111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-98b4d9e7-785e-419a-a31c-e5dec11d47c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.147219 Oct 23 20:09:27.519675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 309/602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:27 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:27.819724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:27.820341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:27.827066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:27.827553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:27.827984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:27.828675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:27.829133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:27.829562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:27.958477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:27.966510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:27.967961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:27.969122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4f6ff6a0-2208-4fc2-9766-9b49a455004a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.153885 Oct 23 20:09:27.969689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 294/603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:27 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:28.545615 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:28.546237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:28.552705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:28.553188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:28.553616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:28.554328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:28.554783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:28.555205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:28.685222 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:28.693396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c21b159d-11b5-43d6-86bc-2d255480ff14 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.151662 Oct 23 20:09:28.693959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 310/604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:28 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:28.994114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:28.994900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:29.001287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:29.001764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:29.002194 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:29.002900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:29.003356 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:29.003777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:29.130623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:29.138537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:29.139996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:29.141137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4048040e-aa4a-49bd-bb8a-5411438eb431 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.150910 Oct 23 20:09:29.141691 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 295/605] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:28 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:29.717178 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:29.717789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:29.724568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:29.725054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:29.725488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:29.726172 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:29.726656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:29.727077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:29.857334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:29.865441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-31658447-a0d9-4e55-800b-07803e999528 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.152025 Oct 23 20:09:29.866012 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 311/606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:29 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:30.167084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:30.167727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:30.174158 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:30.174670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:30.175100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:30.175780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:30.176897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:30.177484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:30.303647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:30.311795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:30.313250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:30.314451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-69b5588c-82f1-49b4-bd9b-b1588d1aff33 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.151231 Oct 23 20:09:30.315015 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 296/607] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:30 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:30.889085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:30.889720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:30.895625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:30.896100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:30.896525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:30.897203 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:30.897655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:30.898073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:31.028609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:31.036773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2289f5b9-cfbc-40f5-9c3b-721294725ca7 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.151708 Oct 23 20:09:31.037329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 312/608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:30 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:31.340267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:31.340877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:31.347277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:31.347759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:31.348709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:31.349396 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:31.349852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:31.350296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:31.475818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:31.483772 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:31.485210 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:31.486385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b2952a1a-b493-4eea-bbc3-09f1f1fd1fc9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.150041 Oct 23 20:09:31.486945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 297/609] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:31 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:32.060459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:32.061067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:32.067580 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:32.068057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:32.068486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:32.069167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:32.069621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:32.070040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:32.195155 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:32.203443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-53da691a-aad9-46e9-8a5b-88f249a56eef tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.146831 Oct 23 20:09:32.204046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 313/610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:32 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:32.512398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:32.513010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:32.519451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:32.519923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:32.520350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:32.521027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:32.521475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:32.521889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:32.651492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:32.659363 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:32.660799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:32.661932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d82e4f40-6388-4623-9856-424a069331ca tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.153431 Oct 23 20:09:32.662511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 298/611] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:32 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:33.228124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:33.228761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:33.234869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:33.235350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:33.235783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:33.236459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:33.236912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:33.237332 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:33.360713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:33.368863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0726f6b6-babf-45b6-ae89-b953f8d99c75 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.144559 Oct 23 20:09:33.369423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 314/612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:33 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:33.688233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:33.688837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:33.696033 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:33.696517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:33.696945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:33.697629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:33.698080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:33.698536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:33.702621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:33.830520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:33.838988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:33.840649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:33.841978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7fdea276-c08c-46f2-bc93-4915fb7a49ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.157782 Oct 23 20:09:33.842725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 299/613] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:33 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:34.392227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:34.392835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:34.398778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:34.399260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:34.399690 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:34.400370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:34.400825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:34.401246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:34.524983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:34.533213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ce39c98a-21dc-4925-acdf-5ecddff4b321 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.144867 Oct 23 20:09:34.533776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 315/614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:34 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:34.867740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:34.868350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:34.874859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:34.875341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:34.875769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:34.876459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:34.876908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:34.877326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:35.007732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:35.015879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:35.017371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:35.018552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-30670f01-c9ef-4418-852b-c800315cfcad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.154711 Oct 23 20:09:35.019113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 300/615] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:34 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:35.557985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:35.558628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:35.564595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:35.565297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:35.565733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:35.566452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:35.567470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:35.567889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:35.698619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:35.706725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3ff04a37-2d4d-41ae-893d-635707fd1cca tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.152829 Oct 23 20:09:35.707288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 316/616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:35 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:36.044594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:36.045211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:36.052325 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:36.052802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:36.053235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:36.053922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:36.054408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:36.054833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:36.179892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:36.187947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:36.189437 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:36.190620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-35dfe277-936e-4e69-8391-2880d0be8ecd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.150025 Oct 23 20:09:36.191183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 301/617] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:36 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:36.729984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:36.730556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:36.736322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:36.736798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:36.737226 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:36.737897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:36.738374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:36.738793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:36.867405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:36.876008 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-722a6ecc-581b-4312-8255-8488ef104713 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.150040 Oct 23 20:09:36.876577 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 317/618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:36 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:37.081331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1086310090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1509594046", "security_groups": [{"name": "tempest-secgroup-smoke-570889231"}], "networks": [{"uuid": "c21c9d8a-c960-40c8-a47d-cd8f04ec2676"}], "block_device_mapping_v2": [{"uuid": "4732fa9b-4281-40a3-b15f-8c11d66c1f4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:37.191239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] validate_networks() for [('c21c9d8a-c960-40c8-a47d-cd8f04ec2676', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:09:37.216516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:37.217125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:37.222981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.223467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.223899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.224585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.225038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.225459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.417830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:37.427491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:37.428935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:37.430153 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-926b1d27-2739-4739-a84a-c04c3002d557 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.217541 Oct 23 20:09:37.431432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 318/619] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:37 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:09:37.620280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:09:37.620695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:09:37.621167 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:09:37.621567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:09:37.621998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:09:37.630638 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.631113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.631544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.632258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.632704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.633117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.649588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Getting quotas for project f84aaa230cf14fd2b47b2076e43fcb73. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:09:37.653537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Getting quotas for user 21fac7ecf4f2435483df150292a0052b and project f84aaa230cf14fd2b47b2076e43fcb73. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:09:37.708213 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:09:37.710412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4732fa9b-4281-40a3-b15f-8c11d66c1f4e',volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:09:37.838561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f89f8b89-72d9-44b1-97a8-56dee1bf7e6c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760940 Oct 23 20:09:37.839217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 302/620] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:09:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:09:37.851149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3077b099-cd79-44a1-8589-daf61137bc0e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:37.851729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3077b099-cd79-44a1-8589-daf61137bc0e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:37.899740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:37.900344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:37.906360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.906892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.907304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.907936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:37.908386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:37.908802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:37.912635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3077b099-cd79-44a1-8589-daf61137bc0e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:37.920151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3077b099-cd79-44a1-8589-daf61137bc0e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1089 microversion: 2.1 time: 0.073198 Oct 23 20:09:37.920710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 319/621] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:37 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:38.040449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:38.048900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-41201ce8-50f4-4901-852e-6b9b4bf932af tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.153013 Oct 23 20:09:38.049461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 303/622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:37 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:38.456742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:38.457608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:38.464200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:38.464677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:38.465101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:38.465782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:38.466230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:38.466689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:38.472277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:38.598417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:38.607313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:38.608773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:38.609914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1e4bb6fa-a19e-4c70-ada8-d0763bf5ce9f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1745 microversion: 2.20 time: 0.157815 Oct 23 20:09:38.610494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 320/623] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:38 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:38.943208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:38.943968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:38.951017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:38.951810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:38.952706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:38.953647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:38.954110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:38.954718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:39.032530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:39.041163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d2835607-f84b-48bf-a580-c4c80eb6dbd4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1187 microversion: 2.1 time: 0.101665 Oct 23 20:09:39.042233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 304/624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:38 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:39.075087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:39.075725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:39.081759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:39.082265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:39.083491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:39.084369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:39.084828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:39.085249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:39.225654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:39.236023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e532ec74-0b43-465c-be75-1369a9e8be44 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1723 microversion: 2.1 time: 0.165395 Oct 23 20:09:39.236865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 321/625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:39 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:39.636642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:39.637247 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:39.643227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:39.643710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:39.644338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:39.645029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:39.645653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:39.646078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:39.786819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:39.803821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:39.805436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:39.807189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-634df584-4c53-40a6-a1cc-9733d09b94be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1745 microversion: 2.20 time: 0.174961 Oct 23 20:09:39.808408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 305/626] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:39 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:40.065305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:40.065918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:40.072705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.073199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.073631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.074466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.075260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.075767 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.209818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:40.218884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9ffa244c-6101-44e7-8386-1e074f04eea0 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.157252 Oct 23 20:09:40.219488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 322/627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:40 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:40.260056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:40.260769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:40.267440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.267919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.268346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.269031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.269481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.269900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.396902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:40.405765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a72621a9-8b26-4f1a-9e07-1dd26154574f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1700 microversion: 2.1 time: 0.150196 Oct 23 20:09:40.406735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 306/628] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:40 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:40.428277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:40.434428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.434914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.435344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.495593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Going to try to start instance {{(pid=118867) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 20:09:40.526526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:40.536987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.537485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.538090 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.545180 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-18d3124b-9fc8-4ef0-88c4-56646f72a0f8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action" status: 202 len: 0 microversion: 2.1 time: 0.120651 Oct 23 20:09:40.546388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 323/629] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:09:40 2022] POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:09:40.555189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:40.556498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:40.557790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] Creating event network-changed:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:09:40.563852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.564446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.564933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.565656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.566430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.566859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.569443 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-8cff755f-e8e6-4e14-b95e-8941ad50bf4b req-81fe203a-8faa-43f8-a0b3-7da4f3d55052 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047625 Oct 23 20:09:40.570614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 307/630] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:40.735270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:40.744494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-58b928c1-72e0-419b-9afd-696ef64878c6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1709 microversion: 2.1 time: 0.193424 Oct 23 20:09:40.745073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 324/631] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:40 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:40.838820 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:40.840820 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:40.848567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.849373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.850110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.851118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.851835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.852594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:40.986009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "name": "network-vif-plugged", "status": "completed", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:40.996964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:40.997694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:40.998452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:41.024476 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] Creating event network-vif-plugged:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:09:41.029984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-2ff21a93-09bc-4c7a-9881-0ed111100779 req-dbfa2014-c81b-47df-969a-32eeb0168d39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047698 Oct 23 20:09:41.030798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 325/632] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:09:41.058527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:41.067392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:41.069182 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:41.070372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c8b293f0-8565-478e-b763-d2198303ba8b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1745 microversion: 2.20 time: 0.239780 Oct 23 20:09:41.071703 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 308/633] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:40 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:41.243980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:41.244682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:41.252568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:41.253039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:41.253473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:41.254168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:41.254676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:41.255098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:41.402379 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:41.409872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-26470b9b-e31a-4886-807a-ab75c7bac94c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.171582 Oct 23 20:09:41.410467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 326/634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:41 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:41.768696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:41.769308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:41.771726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:41.777490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:41.777974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:41.778451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:41.779138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:41.779588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:41.780010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:41.906380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:41.914617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ac1c7483-53b2-4fce-a218-edef66b899cd tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1709 microversion: 2.1 time: 0.149764 Oct 23 20:09:41.915191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 309/635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:41 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:42.096870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:42.097468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:42.099403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=53 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:42.104509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.104981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.105404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:42.106113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.106589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.107004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:42.234726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:42.243191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:42.244758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:42.245907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-84c14370-9275-49fc-b41a-0eb51cf58b60 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1745 microversion: 2.20 time: 0.152956 Oct 23 20:09:42.246498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 327/636] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:42 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:42.433205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:42.433833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:42.439697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.440178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.440607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:42.441287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.441735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.442154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:42.568603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:42.576370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-997d9d87-531f-4d5c-8325-c11c598cb52c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.147479 Oct 23 20:09:42.576939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 310/637] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:42 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:42.939568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:42.940167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:42.946309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.947250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.947358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:42.948007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:42.948457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:42.948922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:43.116040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:43.124241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-08192043-509e-42c1-aa19-89b447d1a8bb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1709 microversion: 2.1 time: 0.188579 Oct 23 20:09:43.124819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 328/638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:42 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:43.271657 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:43.272228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:43.279322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:43.279799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:43.280226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:43.280905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:43.281353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:43.281769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:43.484898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:43.493095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:43.494579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:43.495759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d30dced6-f16a-49ba-9784-6df22bff15d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1745 microversion: 2.20 time: 0.228093 Oct 23 20:09:43.496317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 311/639] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:43 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:43.598985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:43.599732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:43.605908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:43.606429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:43.606890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:43.607570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:43.608018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:43.608439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:43.747985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:43.756251 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c7f2638e-bf37-40b6-9d1e-e8b4b43a7906 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.161180 Oct 23 20:09:43.756822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 329/640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:43 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:44.148746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:44.149936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:44.155929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.156413 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.156844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.157525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.157977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.158433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.284101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:44.292269 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a2df2c01-974d-4945-8905-21fcc408521d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1713 microversion: 2.1 time: 0.147899 Oct 23 20:09:44.292834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 312/641] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:44 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:44.521208 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:44.522483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:44.530828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.531328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.531821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.532461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.532913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.533329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.733700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:44.741573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:44.743073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:44.744200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-88d10778-04d6-4ae2-a2c1-4db7513d6b59 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.227009 Oct 23 20:09:44.744742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 330/642] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:44 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:44.779400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:44.780009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:44.786119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.786594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.787021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.787755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:44.788202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:44.788616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:44.924283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:44.932119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9f4ba624-3d41-404b-8733-8e4bd508ec55 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.156415 Oct 23 20:09:44.946841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 313/643] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:44 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:45.770633 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:45.771282 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:45.777685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:45.778333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:45.778824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:45.779646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:45.780126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:45.780546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:45.931622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:45.940736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:45.942595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:45.943860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9f13d147-3f5f-4cae-8a29-f15b02adb828 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.177475 Oct 23 20:09:45.944501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 331/644] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:45 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:45.954910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:45.956248 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:45.963829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:45.964540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:45.964971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:45.965694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:45.966148 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:45.966674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:46.108451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:46.117387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-af4adac5-6409-4f9a-a143-649906c9211e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.166220 Oct 23 20:09:46.117996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 314/645] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:45 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:46.970191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:46.971446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:46.977974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:46.978425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:46.979091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:46.979978 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:46.980429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:46.981074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:47.139857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:47.141998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:47.143406 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:47.166286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:47.166286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:47.166286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c063d260-5146-415f-b16c-8649162d01bb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.185211 Oct 23 20:09:47.166694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 332/646] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:46 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:47.175679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:47.176287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:47.176587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:47.178270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:47.178733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:47.179447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:47.357979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:47.371942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-07c25ddb-9b7a-43af-ab59-2abef9d2296e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.234705 Oct 23 20:09:47.389808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 315/647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:47 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:48.178953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:48.180329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:48.182610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:48.188488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:48.189106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:48.189771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:48.190889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:48.191606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:48.192335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:48.342626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:48.351733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:48.354162 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:48.355448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cc960c7c-7c40-470d-91a8-f55f0ba0f4af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.180294 Oct 23 20:09:48.356542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 333/648] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:48 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:48.395801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:48.397732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:48.400454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:48.401107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:48.407217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:48.407699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:48.408163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:48.408859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:48.409314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:48.409736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:48.556115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:48.564403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fd6b0eed-b355-4a1d-9e5d-39f6be41eeed tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.172612 Oct 23 20:09:48.565275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 316/649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:48 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:49.385340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:49.385970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:49.392424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:49.393140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:49.393789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:49.394745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:49.395201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:49.395622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:49.531758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:49.541350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:49.542877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:49.544249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2cda2a1f-f1b7-45ee-9585-e204633973e2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.163627 Oct 23 20:09:49.545125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 334/650] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:49 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:49.590516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:49.591635 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:49.598725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:49.599440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:49.600038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:49.600742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:49.601196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:49.601619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:49.606075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:49.744503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:49.752953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9dfa0036-e95b-4f3e-8a2d-7296f7c522b6 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.166919 Oct 23 20:09:49.766769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 317/651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:49 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:50.570728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:50.572252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:50.578751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:50.579242 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:50.579673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:50.580378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:50.580830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:50.581249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:50.741600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:50.751287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:50.752898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:50.754842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-11bbd770-ab4f-4c44-ac17-8de2f2e745ea tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.187704 Oct 23 20:09:50.756500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 335/652] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:50 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:50.778282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:50.778282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:50.784069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:50.784559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:50.784995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:50.785692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:50.786150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:50.786614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:50.945422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:50.954362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-15fc430d-74b1-407f-903a-bcada1b86a93 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.181661 Oct 23 20:09:50.970621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 318/653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:50 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:51.781361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:51.782054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:51.788237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:51.788724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:51.789151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:51.796635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:51.797165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:51.797596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:51.818507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:51.945722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:51.955431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:51.957415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:51.958579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1b536d64-b0b8-4d14-b82e-5779fce85471 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.181097 Oct 23 20:09:51.959619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 336/654] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:51 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:51.977411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:51.978174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:51.987096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:51.987757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:51.988250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:51.988964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:51.989422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:51.989846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:52.130801 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:52.140640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a293c04a-c504-40d6-be1d-7a4a120e131d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.167493 Oct 23 20:09:52.141425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 319/655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:51 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:52.686904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:52.689461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:52.696305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:52.697252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:52.697378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:52.698070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:52.698640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:52.699133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:52.775654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-29fe6563-ab62-46bd-92af-d8c14586e8b3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action" status: 202 len: 0 microversion: 2.1 time: 0.092356 Oct 23 20:09:52.776355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 337/656] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:09:52 2022] POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:09:52.786993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:52.788322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:52.794288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:52.794977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:52.795398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:52.797592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:52.798423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:52.799002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:52.993672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:52.995188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:53.014723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:53.015566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:53.016322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:53.017344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:53.017975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:53.019484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:53.095891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:53.110305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-97439f16-eacb-4382-ae17-0231ba529d5f tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1753 microversion: 2.1 time: 0.328741 Oct 23 20:09:53.111699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 320/657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:52 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1753 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:53.165171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:53.165919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:53.177184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:53.177682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:53.178279 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:53.179035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:53.179495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:53.179934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:53.388948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:53.397264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:53.398713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:53.400592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f48987a6-cafa-4cdb-a65d-ab6ecb3c39db tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.415930 Oct 23 20:09:53.414747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 338/658] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:52 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:53.424140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "name": "network-vif-plugged", "status": "completed", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:53.434745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:53.435410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:53.435995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:53.448450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] Creating event network-vif-plugged:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:09:53.455828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-b671b614-5bad-4342-92b3-0c9174da02f7 req-2ebe476f-5257-4dfc-9c11-5318eb905737 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Oct 23 20:09:53.460427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 339/659] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:53.504774 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:53.514821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-603cd90e-16f0-4467-90ab-6fd75a439879 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.353562 Oct 23 20:09:53.516600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 321/660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:53 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:54.136860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:54.137583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:54.145771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.146283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.146714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.147408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.147853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.148457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.303376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:54.312560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a24b1214-feb1-4095-8e31-2def92f506ef tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.180681 Oct 23 20:09:54.313134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 340/661] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:54 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:54.431598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:54.432143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:54.440702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.441249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.441695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.442420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.442877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.443295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.540506 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:54.541484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:54.551446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.552054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.552680 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.553385 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:54.553846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:54.554289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:54.583567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:54.592468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:54.593911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:54.595101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-50349a8c-f904-411c-a8e5-fab0f18f56e0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.169416 Oct 23 20:09:54.595883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 322/662] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:54 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:54.683590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:54.691116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b9c569d3-81d1-444d-9b9d-5b5d1fc3b011 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1260 microversion: 2.1 time: 0.156263 Oct 23 20:09:54.691681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 341/663] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:54 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:55.336825 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:55.337431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:55.343301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.343780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.344207 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.344887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.345337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.345753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.485131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:55.493921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-de94986d-d765-4d5e-8094-26ff3b519159 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.160939 Oct 23 20:09:55.494518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 323/664] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:55 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:55.620037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:55.620579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:55.626489 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.626973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.627408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.628093 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.628548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.628969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.714747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:55.715363 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:55.722692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.723412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.723843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.724544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.724997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.725424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.760890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:55.768912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:55.770389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:55.771548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a0e44182-ec3b-41c5-a149-631af7fbafef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1740 microversion: 2.20 time: 0.155464 Oct 23 20:09:55.772115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 342/665] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:55 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:55.858007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:55.866313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8db807ce-3c36-430e-9c9f-8a9b2a966c18 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1445 microversion: 2.1 time: 0.155959 Oct 23 20:09:55.866894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 324/666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:55 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:09:55.887991 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:55.888514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:55.894742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.895237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.895652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:55.896348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:55.896803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:55.897535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:56.031600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:56.039278 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5a412096-8c06-4789-bf1a-89b4b16e7bdc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1445 microversion: 2.1 time: 0.155224 Oct 23 20:09:56.040086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 343/667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:55 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:56.517968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:56.518608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:56.526937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:56.527919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:56.528359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:56.529372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:56.529832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:56.530561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:56.790190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:56.796852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:56.798166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:56.799140 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-02ab9323-df8b-4fbe-a3fa-6a5c760499be tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.285902 Oct 23 20:09:56.802476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 325/668] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:56 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:56.817390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:56.820312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:56.822777 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:56.823684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:56.824154 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:56.824581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:57.077038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:57.085159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:57.086989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:57.088163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3b663e4d-2472-47b1-a170-516271828a19 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1722 microversion: 2.20 time: 0.295077 Oct 23 20:09:57.088949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 344/669] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:56 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:57.828229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:57.828972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:57.835019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:57.835502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:57.835947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:57.837533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:57.837695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:57.838606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:57.847926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:57.858063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:57.858931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:57.859973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:57.872297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] Creating event network-changed:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:09:57.877371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-254cab74-ad79-4ae2-9430-8342c4c7c7d3 req-07cee46c-3c34-4d52-84b5-ebc8a3020d70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Oct 23 20:09:57.877962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 345/670] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:09:57.995361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:58.003621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fd6ed006-7530-41f6-917a-3a65c84136bb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.179408 Oct 23 20:09:58.004204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 326/671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:57 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:58.113506 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:58.114466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:58.121031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:58.121510 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:58.121944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:58.122649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:58.123103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:58.123522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:58.254365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:58.262785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:58.264234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:58.265452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-69c6df61-9ef9-46ab-8d2f-fce43c442392 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1722 microversion: 2.20 time: 0.156227 Oct 23 20:09:58.266031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 346/672] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:58 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:59.035111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:59.035673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:59.043814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.045949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.046784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.048836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.049303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.050713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.112357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "name": "network-vif-unplugged", "status": "completed", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:59.128617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.129787 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.130440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.146718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] Creating event network-vif-unplugged:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:09:59.153783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-3732183b-5f8b-491a-b079-37380608bec3 req-caef07c7-5ce5-4dd5-8d58-a675e0c5a66e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046299 Oct 23 20:09:59.155213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 347/673] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:09:59.219694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:59.229460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-eebba987-fc43-44f2-aa92-a6442506059c tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.205841 Oct 23 20:09:59.230790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 327/674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:09:59 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:09:59.291669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:09:59.292301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:59.298374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.298854 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.299275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.299942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.300397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.300811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.431874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:59.440301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:59.441725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:09:59.442892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-65d1e23c-735c-4e82-a78a-480b88dda40f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1725 microversion: 2.20 time: 0.156129 Oct 23 20:09:59.443442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 348/675] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:09:59 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:09:59.468312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929e7185-0542-47cc-8a07-07713c720f1c"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:59.470900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:59.476786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.477812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.478265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.478957 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.479409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.479831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.769652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-12f86fe3-ed3d-42e4-9b92-9d6bb2403b41 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305287 Oct 23 20:09:59.770279 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 328/676] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 23 20:09:59 2022] POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:09:59.894964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:09:59.895544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:09:59.901479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.901953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.902408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.903082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:09:59.903525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:09:59.903936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:09:59.945430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118867) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 20:10:00.012269 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3c97a6a6-7e7e-4495-8f8b-ec92ecc3046b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/action" status: 202 len: 0 microversion: 2.20 time: 0.121099 Oct 23 20:10:00.012968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 349/677] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 20:09:59 2022] POST /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:10:00.021346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:00.021958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:00.029553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:00.030035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:00.030501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:00.031196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:00.031651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:00.032079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:00.161911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:00.171068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:00.172521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:00.173671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9e553d82-7f5b-48f0-a891-b196abee240b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1751 microversion: 2.20 time: 0.156540 Oct 23 20:10:00.174231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 329/678] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:00 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:00.253123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:00.253859 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:00.260274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:00.260755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:00.261188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:00.261968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:00.262456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:00.262876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:00.448703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:00.456936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2e328df9-ee38-4fd2-82dd-b2e40dfc5559 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.208037 Oct 23 20:10:00.457505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 350/679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:00 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:01.199298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:01.199902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:01.206191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:01.206696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:01.207120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:01.207792 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:01.208239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:01.208658 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:01.337480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:01.345850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:01.347320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:01.348461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c11595fa-484d-45bc-8891-d456d8b1b5d3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1753 microversion: 2.20 time: 0.153699 Oct 23 20:10:01.349018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 330/680] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:01 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:01.480853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:01.481363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:01.487516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:01.488006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:01.488450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:01.489117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:01.489565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:01.489982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:01.635350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:01.643569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cc7d6fdb-0d8c-4216-be4a-4a7ea9f4e481 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.166563 Oct 23 20:10:01.644142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 351/681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:01 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:02.373923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:02.374561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:02.380949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:02.381441 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:02.381878 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:02.382605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:02.383263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:02.383700 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:02.387840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:02.667865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:02.668725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:02.675245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:02.675737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:02.676161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:02.677225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:02.677841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:02.678470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:02.778204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:02.787489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:02.788955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:02.790418 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e0cdfdfb-35f3-419d-a971-3c5fdc802a5f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.420233 Oct 23 20:10:02.790985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 331/682] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:02 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:02.872934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:02.881173 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d019b2e6-c240-4400-8302-795157e4a2a3 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.217997 Oct 23 20:10:02.881753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 352/683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:02 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:03.818633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:03.820212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:03.831112 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:03.831660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:03.832275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:03.833286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:03.833899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:03.834607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:03.905888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:03.907134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:03.913182 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:03.913672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:03.914109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:03.915431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:03.915888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:03.916310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:03.920558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:03.999027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:04.007556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:04.009415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:04.010633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e1d75584-0a1d-4fe2-88d2-d0bab78598b3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.199102 Oct 23 20:10:04.014539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 332/684] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:03 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:04.083783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:04.091952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-700e4cec-779f-4c3f-ae3e-6d6db31965da tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.190293 Oct 23 20:10:04.092522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 353/685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:03 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:05.036959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:05.037564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:05.045550 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:05.046271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:05.046923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:05.047670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:05.048127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:05.048550 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:05.115794 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:05.117394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:05.124784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:05.129419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:05.130111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:05.133025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:05.140029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:05.140573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:05.197666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:05.217479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:05.219486 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:05.220992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bd187916-77b0-45d2-8145-c1b7140721e6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.187975 Oct 23 20:10:05.221683 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 333/686] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:05 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:05.300366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:05.309133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cdb96b07-8a1e-4282-be88-b190c8319e91 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.197270 Oct 23 20:10:05.309694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 354/687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:05 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:06.248454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:06.249202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:06.259410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:06.259920 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:06.260543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:06.261434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:06.262044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:06.262650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:06.332730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:06.333992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:06.339974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:06.340455 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:06.340884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:06.341576 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:06.354943 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:06.355394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:06.436154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:06.445027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:06.447078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:06.448235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-57a4b94f-13bf-4049-b81f-59af46bcdfb5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.204545 Oct 23 20:10:06.448974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 334/688] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:06 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:06.522473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:06.530542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3e25290a-2936-4bfa-9361-cfa00a72488a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.201887 Oct 23 20:10:06.531101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 355/689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:06 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:07.473789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:07.474442 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:07.481009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:07.481496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:07.481929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:07.482650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:07.483107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:07.483529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:07.556301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:07.558168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:07.565279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:07.566151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:07.567098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:07.568406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:07.568762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:07.569749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:07.646670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:07.656092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:07.659495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:07.660719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1ece8e8e-3e84-47fb-92e3-08a98897d3ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.190834 Oct 23 20:10:07.661295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 335/690] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:07 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:07.730757 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:07.739549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4e02fa4d-8bfd-48ae-8019-8e812f0c9ecc tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.188120 Oct 23 20:10:07.740134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 356/691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:07 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:08.684952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:08.685578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:08.692108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:08.692582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:08.693020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:08.694111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:08.694234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:08.694602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:08.764931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:08.765526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:08.772141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:08.772659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:08.773088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:08.773784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:08.775000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:08.775817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:08.863224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:08.874119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:08.876389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:08.877627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-834db599-898d-469a-82ba-7388a881ca63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.196516 Oct 23 20:10:08.878302 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 336/692] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:08 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:08.949116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:08.957599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bf02688a-252f-43a6-8238-ed3bda1e7505 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.197192 Oct 23 20:10:08.958388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 357/693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:08 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:09.904967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:09.905590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:09.912306 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:09.912794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:09.913234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:09.913932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:09.914421 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:09.915508 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:09.980953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:09.982218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:09.992113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:09.992932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:09.993587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:09.994559 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:09.995029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:09.995448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:10.131233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:10.147816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:10.149776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:10.150962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-959b7c51-bb6a-4188-86dc-510dde2940cb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.250213 Oct 23 20:10:10.151535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 337/694] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:09 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:10.174508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:10.182660 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7eebe3ec-abd0-4ab7-a61a-50a55d4422db tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.206054 Oct 23 20:10:10.183223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 358/695] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:09 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:11.177092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:11.177694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:11.184733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:11.185215 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:11.185647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:11.186366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:11.186822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:11.187242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:11.207254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:11.209202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:11.215913 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:11.217025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:11.218409 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:11.219347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:11.220012 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:11.220642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:11.365220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:11.375305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:11.376759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:11.377938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-da3d1ba9-6d40-4630-99be-01f9ae2cc2aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.205209 Oct 23 20:10:11.378880 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 338/696] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:11 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:11.470996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:11.484791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-16eae0ad-31ec-4ee5-a163-b652c6e509a5 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.281735 Oct 23 20:10:11.486299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 359/697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:11 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:12.403560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:12.404179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:12.406456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=60 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:12.412310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:12.412796 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:12.413229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:12.413926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:12.414400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:12.414821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:12.510103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:12.512149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:12.521097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:12.523432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:12.524638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:12.525241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:12.526199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:12.526895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:12.527335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:12.555181 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:12.562735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:12.564195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:12.565365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e8587e80-5e15-46f3-b543-84c7fab34014 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.165686 Oct 23 20:10:12.566118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 339/698] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:12 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:10:12.684774 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:12.693363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-943d85da-f3ae-4ba3-a3eb-6e5e0c8c8fb8 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.188715 Oct 23 20:10:12.693938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 360/699] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:12 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:13.591934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:13.592832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:13.599586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:13.600228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:13.600686 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:13.601461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:13.602186 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:13.603350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:13.717673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:13.718677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:13.728056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:13.729203 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:13.729837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:13.730661 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:13.731194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:13.731703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:13.828968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:13.839238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:13.841436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:13.843295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-16b50b08-29a5-4869-ba79-98f9321f4ce5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.255445 Oct 23 20:10:13.855111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 340/700] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:13 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:13.905795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:13.914370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8db0abca-8a51-478a-875d-8cacd7d934aa tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.200714 Oct 23 20:10:13.915665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 361/701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:13 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:14.871225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:14.872092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:14.881231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:14.881720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:14.882385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:14.883112 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:14.883593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:14.884014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:14.940097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:14.940881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:14.947543 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:14.948029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:14.948454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:14.949143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:14.949590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:14.950003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:15.063173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:15.072907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:15.074377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:15.075540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-da12a3a8-64a6-48ff-9ba2-a25293f54ba3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.208766 Oct 23 20:10:15.076283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 341/702] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:14 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:15.124808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:15.133142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a182ded2-16bc-4811-8d1f-88e33131e1cb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.198467 Oct 23 20:10:15.133714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 362/703] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:14 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:16.100866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:16.101472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:16.108090 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:16.108564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:16.108989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:16.109672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:16.110111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:16.110545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:16.155126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:16.155708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:16.161509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:16.161989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:16.162481 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:16.163167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:16.163617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:16.164033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:16.298326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:16.307543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:16.308987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:16.310172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d8a6acd5-aa1b-4dcb-affd-a8aa13e7352f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.213187 Oct 23 20:10:16.310793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 342/704] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:16 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:16.336808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:16.344841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-070c512a-b1b1-4f09-8517-7dab6a6f37fb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.193512 Oct 23 20:10:16.345400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 363/705] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:16 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:17.335164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:17.335772 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:17.342621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:17.343099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:17.343531 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:17.344206 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:17.344655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:17.345075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:17.368014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:17.368620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:17.374390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:17.374870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:17.375298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:17.375980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:17.376432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:17.376850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:17.523551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:17.532599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:17.534031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:17.535217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1e1f3db9-67ab-4c9b-9855-28e988d90fa9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.203982 Oct 23 20:10:17.535780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 343/706] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:17 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:17.561951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:17.570829 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e2164085-28c0-4bba-b968-dd7c9acf44c6 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.206553 Oct 23 20:10:17.571662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 364/707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:17 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:18.560862 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:18.561460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:18.567803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:18.568276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:18.568699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:18.569374 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:18.569818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:18.570232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:18.594384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:18.595000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:18.600824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:18.601300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:18.601727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:18.602439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:18.602890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:18.603306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:18.746773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:18.755303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:18.756746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:18.757915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b3da617d-c189-432c-adf5-989279ba22ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.200994 Oct 23 20:10:18.759016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 344/708] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:18 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:18.784374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:18.792585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f4153193-7e09-41c3-b2c2-886f5c3011b4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.202018 Oct 23 20:10:18.793148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 365/709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:18 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:19.784596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:19.785115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:19.791834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:19.792316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:19.792749 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:19.793428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:19.793880 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:19.794330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:19.815932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:19.816649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:19.823632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:19.824146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:19.824581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:19.825281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:19.825736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:19.826160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:19.988166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:19.998351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:19.999915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:20.001225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-aef379c4-3127-48f8-9b74-34bcb91102b5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.220615 Oct 23 20:10:20.002334 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 345/710] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:19 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:20.022488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:20.030609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f26d3328-627e-45fc-8779-5ccad728c3ca tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1758 microversion: 2.1 time: 0.218409 Oct 23 20:10:20.031170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 366/711] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:19 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:21.027447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:21.028084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:21.034510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:21.034987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:21.035416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:21.036092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:21.036544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:21.036960 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:21.053031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:21.053628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:21.059897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:21.060370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:21.060797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:21.061468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:21.061919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:21.062355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:21.229496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:21.238122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:21.239613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:21.240798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c80a35a3-ce93-4581-b470-c34214b0e95f tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.217764 Oct 23 20:10:21.241366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 346/712] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:21 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:21.249052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:21.257249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1a3050e4-5f36-4f4d-a0a5-d1013f249cd4 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1761 microversion: 2.1 time: 0.207988 Oct 23 20:10:21.257808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 367/713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:21 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1761 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:10:22.266948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:22.267547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:22.274773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:22.275190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:22.275615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:22.276288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:22.276732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:22.277149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:22.405718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:22.409137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=100 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:22.415177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:22.416603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:22.417748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-18f5f24d-c4fb-4ad8-a5c5-5fc57b8e5aae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.154715 Oct 23 20:10:22.418339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 347/714] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:22 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:23.442866 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:23.443464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:23.450188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:23.450691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:23.451115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:23.451781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:23.452223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:23.452633 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:23.577022 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:23.585338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:23.586789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:23.587926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-30f6782d-8f5a-4dab-842e-0adfc1ab1fcb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.148948 Oct 23 20:10:23.588479 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 368/715] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:23 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:24.612875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:24.613481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:24.620874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:24.621403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:24.621787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:24.622576 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:24.623030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:24.623451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:24.752048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:24.760515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:24.762076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:24.763261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-336b7636-e3d3-4640-ba5e-1820cd47c9d4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.154281 Oct 23 20:10:24.763819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 348/716] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:24 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:25.888498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:25.889096 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:25.894837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:25.895310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:25.895735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:25.896400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:25.896850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:25.897262 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:26.034640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:26.038044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:26.044604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:26.045974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:26.047168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-29a0b1a4-d71c-46d1-8097-90e07d2db027 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.262630 Oct 23 20:10:26.047731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 369/717] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:25 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:27.072403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:27.073001 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:27.079346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:27.079818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:27.080244 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:27.080919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:27.081364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:27.081781 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:27.205154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:27.214048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:27.215517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:27.216855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-363540a8-8eb0-4c16-a2b2-90f3ef96e40a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.148578 Oct 23 20:10:27.217691 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 349/718] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:27 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:28.243856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:28.244464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:28.250630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:28.251116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:28.251547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:28.252233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:28.252684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:28.253107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:28.380982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:28.389802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:28.391292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:28.392449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6baa8739-7cf0-4b58-828c-58d7bd7853aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.153357 Oct 23 20:10:28.393011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 370/719] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:28 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:29.416923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:29.417548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:29.423941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:29.424410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:29.424843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:29.425530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:29.425990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:29.426454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:29.550517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:29.559477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:29.560941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:29.562096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2deef5c0-853c-424c-88ea-c51b3294ef70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.149141 Oct 23 20:10:29.562702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 350/720] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:29 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:30.588786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:30.589605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:30.595827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:30.596302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:30.596726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:30.597401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:30.597849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:30.598283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:30.725588 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:30.734064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:30.735534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:30.736679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-46acdd63-cd61-4bcd-9347-b93411a5bcfa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.152379 Oct 23 20:10:30.737230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 371/721] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:30 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:31.322599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "name": "network-vif-plugged", "status": "completed", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:10:31.332994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:31.333464 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:31.333887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:31.344930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] Creating event network-vif-plugged:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:10:31.350459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-40058491-5380-47d5-af68-133440996d7a req-43c282ae-3328-4ced-a13b-aadfb1c53622 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Oct 23 20:10:31.351046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 351/722] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:10:31.766459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:31.767060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:31.774079 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:31.774615 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:31.775108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:31.775816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:31.776270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:31.776698 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:31.918632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:31.927354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:31.928798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:31.929973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c721b3c7-46bf-4d2e-9076-055d23750c70 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.171788 Oct 23 20:10:31.930743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 372/723] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:31 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:32.956985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:32.957673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:32.964391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:32.964873 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:32.965304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:32.966065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:32.966547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:32.966966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:33.094673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:33.103765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:33.105218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:33.106411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9db32af1-b1fb-45aa-a655-d7126b8129b2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.154148 Oct 23 20:10:33.106962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 352/724] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:32 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:34.132364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:34.132975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:34.138953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:34.139437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:34.139916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:34.140934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:34.141423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:34.141846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:34.276494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:34.285421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:34.286961 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:34.288107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-21c7dc64-86e9-4c18-9910-d3004fa330d7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1809 microversion: 2.20 time: 0.159680 Oct 23 20:10:34.288673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 373/725] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:34 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:35.313669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:35.314230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:35.320687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:35.321157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:35.321841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:35.322546 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:35.322993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:35.323406 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:35.448843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:35.457394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:35.458864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:35.460015 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d2729645-89b3-4b7c-8fdd-34a79f563752 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1796 microversion: 2.20 time: 0.150442 Oct 23 20:10:35.460572 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 353/726] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:10:35 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1796 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:10:42.020910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "573e31b1-e499-4e8f-a740-f65f41bc098f"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:10:42.023400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:42.029840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:42.030349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:42.030775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:42.031454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:42.031899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:42.032313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:42.319088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fba9a418-382d-410c-a922-65ad7ab251d1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399903 Oct 23 20:10:42.319874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 374/727] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:10:41 2022] POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:10:49.849670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:10:49.851868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:49.853986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=29 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:49.854671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=32 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:49.860092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:49.860571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:49.861004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:49.861688 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:49.862141 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:49.862587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:49.885754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'flavor' on Instance uuid 0850267f-8db1-4863-8a9f-661c2cba3304 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:10:50.004287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-526d973c-2267-437d-bfa5-4d0f0b381269 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/action" status: 200 len: 32 microversion: 2.1 time: 0.158551 Oct 23 20:10:50.004961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 354/728] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:10:49 2022] POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:10:50.014964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:50.015670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:50.018736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=30 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:50.024322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:50.024817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:50.025255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:50.025966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:50.026458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:50.026882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:50.159858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:50.168474 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8b81742e-db51-4a2b-9c01-a2c7c9eff1cf tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.157807 Oct 23 20:10:50.169039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 375/729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:50 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:51.192968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:51.193669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:51.201205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:51.201685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:51.202113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:51.202833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:51.203286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:51.203705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:51.331151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:51.339249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-09743b95-2c58-423f-a8bb-a95a9f251e4c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.150988 Oct 23 20:10:51.339814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 355/730] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:51 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:52.362848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:52.363452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:52.370224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:52.370810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:52.371298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:52.372057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:52.372526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:52.372942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:52.496806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:52.505074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a807a037-68d2-4fd0-8e38-56c102b4e70c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.146156 Oct 23 20:10:52.505639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 376/731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:52 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:53.529144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:53.529789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:53.536136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:53.536620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:53.537051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:53.537738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:53.538192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:53.538640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:53.665492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:53.673621 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f208e960-4e83-4219-af0e-986bfddb411b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.148347 Oct 23 20:10:53.674187 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 356/732] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:53 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:54.696486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:54.697365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:54.703622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:54.704097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:54.704520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:54.705191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:54.705640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:54.706056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:54.833287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:54.841842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c4fbdc17-4611-4e66-80f3-3286471503c1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.149244 Oct 23 20:10:54.842427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 377/733] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:54 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:55.865027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:55.865627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:55.871937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:55.872443 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:55.872868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:55.873544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:55.873994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:55.874441 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:56.003346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:56.012014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-88d5e723-636e-46c7-85ad-65649e0ac031 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.150937 Oct 23 20:10:56.012581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 357/734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:55 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:57.035299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:57.035907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:57.042268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:57.042749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:57.043180 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:57.043857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:57.044312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:57.044773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:57.171670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:57.179740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c6d5527c-fa31-4010-8b1e-28134d0a3f02 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.148272 Oct 23 20:10:57.180309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 378/735] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:57 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:58.203019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:58.203631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:58.209951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:58.210472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:58.210910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:58.211593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:58.212045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:58.212470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:58.338511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:58.346576 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3944384b-cb77-470d-a61b-c6f1f217c83c tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.147423 Oct 23 20:10:58.347159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 358/736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:58 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:10:59.370320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:10:59.370930 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:10:59.377176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:59.377661 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:59.378089 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:59.378796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:10:59.379248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:10:59.379667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:10:59.382146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:59.505946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:10:59.513966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b9e1ab88-7729-43c6-817a-aaad8f8da658 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.147827 Oct 23 20:10:59.514567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 379/737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:10:59 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:00.536880 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:00.537409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:00.544459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:00.544946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:00.545388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:00.546106 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:00.546593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:00.547022 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:00.671566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:00.679701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-90336782-ce54-40ae-9d80-7673f7bb94f1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.146743 Oct 23 20:11:00.680272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 359/738] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:00 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:01.703728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:01.704284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:01.710564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:01.711069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:01.711500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:01.712177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:01.712621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:01.713037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:01.842564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:01.851326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-87737f04-b195-4650-a2a1-70fae59bf2ca tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.151465 Oct 23 20:11:01.851887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 380/739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:01 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:02.079467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:02.079958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:02.085785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:02.086282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:02.086717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:02.087439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:02.087891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:02.088310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:02.209742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lazy-loading 'services' on Instance uuid 80f3d6cd-5a81-425b-a929-808f46010e76 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:11:02.321440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7ff24c47-f964-4314-9289-1354be369978 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments/78e29f96-13e2-4da8-8884-e447d960bbab" status: 202 len: 0 microversion: 2.1 time: 0.342774 Oct 23 20:11:02.322394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 360/740] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:11:01 2022] DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments/78e29f96-13e2-4da8-8884-e447d960bbab => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:11:02.873946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:02.874575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:02.881292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:02.881768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:02.882200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:02.882916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:02.883372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:02.884323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:03.021122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:03.029960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-af303f51-faa6-4442-9317-378220a2197d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.159855 Oct 23 20:11:03.030553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 381/741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:02 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:03.443756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:03.450643 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:03.451130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:03.451560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:03.473089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Going to try to stop instance {{(pid=118866) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 20:11:03.514038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-55691c13-e039-48ad-be56-6109bff1317e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action" status: 202 len: 0 microversion: 2.1 time: 0.074444 Oct 23 20:11:03.514663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 361/742] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:11:03 2022] POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:11:03.522527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:03.523134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:03.529031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:03.529387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:03.529817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:03.530531 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:03.531160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:03.531581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:03.662132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:03.669769 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-09322f9a-d05e-4b3d-bb57-360e08c0ce76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.151022 Oct 23 20:11:03.670351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 382/743] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:03 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:04.052362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:04.053053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:04.059581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:04.060055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:04.060481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:04.061160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:04.061637 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:04.062053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:04.188413 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:04.196586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fec49e4a-343c-466f-a145-96dd27bf3f83 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.148395 Oct 23 20:11:04.197415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 362/744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:04 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:04.692807 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:04.693442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:04.700638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:04.701119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:04.701553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:04.702236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:04.702715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:04.703138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:04.826741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:04.834395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-784ec4a2-c082-4033-8773-0a059f77b1fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.145386 Oct 23 20:11:04.834967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 383/745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:04 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:05.219868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:05.220484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:05.226864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:05.227350 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:05.227782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:05.228477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:05.228935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:05.229361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:05.359488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:05.367502 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c6a59bd8-4c91-4366-b079-a5b0a7948ff2 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.151601 Oct 23 20:11:05.368549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 363/746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:05 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:05.859457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:05.860075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:05.866514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:05.866997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:05.867440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:05.868686 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:05.869155 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:05.869582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:05.996673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:06.004493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5be09189-b447-476e-a0f5-6cf7ca8c9c9d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.148939 Oct 23 20:11:06.005052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 384/747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:05 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:06.390881 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:06.391512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:06.397813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:06.398328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:06.398760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:06.399956 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:06.400407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:06.400824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:06.529860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:06.537910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-24eb3789-3d43-47e2-b530-082bbd483bb1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.150980 Oct 23 20:11:06.538503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 364/748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:06 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:07.027556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:07.028170 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:07.034440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:07.034917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:07.035340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:07.036015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:07.036464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:07.036876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:07.161149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:07.169493 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-adc39cb0-674d-4f8d-bc9f-f97a86be0032 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.145745 Oct 23 20:11:07.170071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 385/749] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:07 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:07.560705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:07.561303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:07.567707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:07.568179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:07.568602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:07.569274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:07.569727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:07.570142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:07.700706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:07.708768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-87e7e438-aea0-4fc5-ba1e-e3b546872315 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.151845 Oct 23 20:11:07.709330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 365/750] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:07 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:08.193200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:08.193797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:08.200940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:08.201427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:08.201860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:08.202573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:08.203030 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:08.203451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:08.328886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:08.336570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fb5536e5-556b-4e55-8025-e41772e39f95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.147311 Oct 23 20:11:08.337142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 386/751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:08 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:08.732898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:08.733510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:08.740021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:08.740507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:08.740942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:08.741631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:08.742086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:08.742541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:08.872288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:08.875811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:08.881477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b1c12c53-81d0-4f5c-8507-9d3f0a0f5604 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.152499 Oct 23 20:11:08.882061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 366/752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:08 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:09.359819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:09.360592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:09.368044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:09.368563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:09.369077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:09.369842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:09.370326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:09.370753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:09.501700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:09.509793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0c53f37a-a6dc-4302-a3a4-716c3df77adc tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.153900 Oct 23 20:11:09.510366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 387/753] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:09 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:09.904649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:09.905287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:09.912644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:09.913126 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:09.913560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:09.914263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:09.914732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:09.915156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:10.041400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:10.049612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-69ce67c2-f2a5-43a1-a98e-3511db256ca8 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.149413 Oct 23 20:11:10.050178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 367/754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:09 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:10.533092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:10.533708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:10.540620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:10.541108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:10.541542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:10.542227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:10.542725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:10.543150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:10.670150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:10.677817 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-39e536c6-d671-4665-a354-d6a6eb7c14fa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.148668 Oct 23 20:11:10.678404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 388/755] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:10 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:11.076510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:11.077193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:11.085061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:11.085541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:11.085966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:11.086700 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:11.087750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:11.088174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:11.213403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:11.222292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-17aaa287-dc14-4516-a230-628498d7677a tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.152624 Oct 23 20:11:11.222874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 368/756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:11 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:11.700912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:11.701553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:11.707887 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:11.708367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:11.708798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:11.709481 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:11.709932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:11.710383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:11.837288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:11.845136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a89a9c67-48df-40d9-9913-87e7266ee1a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.148308 Oct 23 20:11:11.845707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 389/757] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:11 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:12.245510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:12.246121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:12.252594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:12.253074 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:12.253508 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:12.254193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:12.254675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:12.255098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:12.382619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:12.390777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-19e9c34a-cd00-4aba-b758-f160f8b5d45d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.149253 Oct 23 20:11:12.391357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 369/758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:12 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:12.870573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:12.871202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:12.877241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:12.877717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:12.878176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:12.878882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:12.879329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:12.879746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:13.014344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:13.022874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eb7beb4a-4193-4943-8b38-374815cc41d5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.156022 Oct 23 20:11:13.022874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 390/759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:12 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:13.414517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:13.415567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:13.421857 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:13.422366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:13.422802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:13.423487 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:13.423940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:13.424360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:13.552828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:13.560943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5f2e6493-b792-40c0-9bc9-8ac48bb1d121 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1735 microversion: 2.1 time: 0.150383 Oct 23 20:11:13.561503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 370/760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:13 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:14.046847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:14.047459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:14.053793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.054299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.054739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.056075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.056537 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.056960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.183800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:14.191655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-876cdfa2-5dea-4df2-8cca-f07b998670e6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.148608 Oct 23 20:11:14.192224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 391/761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:14 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:14.584095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:14.584743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:14.591601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.592084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.592517 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.593204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.593660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.594083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.723958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:14.732287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1b0f6cfd-74de-45f2-b279-7f5fddf34855 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1715 microversion: 2.1 time: 0.152042 Oct 23 20:11:14.732855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 371/762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:14 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:14.793386 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:14.793877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:14.800804 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.801285 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.801715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.802438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.802893 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.803312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.926004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] HTTP exception thrown: Cannot 'detach_volume' instance 0850267f-8db1-4863-8a9f-661c2cba3304 while it is in vm_state rescued Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Request method failure captured: Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments/573e31b1-e499-4e8f-a740-f65f41bc098f HTTP/1.1 Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6GJSHS7PE_rhsH1AThlFNasoBL6ha9FEFafOtUV-zPBMkfti6CC_gtYVpttrReSsvhSG8Sv9lljUzzUEwxH2wrwtwzXMo3KdgVuHRXo1JEnupgg36Fgbv-_Qu2ZXTqiTCBzlv-Ax6p7bQdTfH3NOqRJIjQVlLCQvZ6gpdgW4Tzmkc Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:11:14.927669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41c21bcf4ca457391486c08565b2aae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}] Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 4b6a101d23df4b62ba7e0c35d28d2a3c Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:11:14.928983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Cannot 'detach_volume' instance 0850267f-8db1-4863-8a9f-661c2cba3304 while it is in vm_state rescued Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'server_id': '0850267f-8db1-4863-8a9f-661c2cba3304', 'id': '573e31b1-e499-4e8f-a740-f65f41bc098f'} Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:11:14.929725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0850267f-8db1-4863-8a9f-661c2cba3304 while it is in vm_state rescued Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0850267f-8db1-4863-8a9f-661c2cba3304 while it is in vm_state rescued Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:14.931266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Returning 409 to user: Cannot 'detach_volume' instance 0850267f-8db1-4863-8a9f-661c2cba3304 while it is in vm_state rescued {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:11:14.932574 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1efcc006-1796-4e93-95c0-b21ca247a1c7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments/573e31b1-e499-4e8f-a740-f65f41bc098f" status: 409 len: 152 microversion: 2.1 time: 0.139665 Oct 23 20:11:14.932574 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 392/763] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:11:14 2022] DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments/573e31b1-e499-4e8f-a740-f65f41bc098f => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 20:11:14.937945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:14.938493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:14.944270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.944748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.945170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:14.945846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:14.946316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:14.946735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:15.167070 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a0419b58-1b05-4375-85c3-25a26e6411dc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/action" status: 202 len: 0 microversion: 2.1 time: 0.232678 Oct 23 20:11:15.171430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 372/764] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:11:14 2022] POST /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:11:15.176973 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:15.178160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:15.185773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:15.187074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:15.187841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:15.188579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:15.189032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:15.189451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:15.217000 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:15.217701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:15.224268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:15.224753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:15.225328 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:15.226023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:15.226587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:15.227014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:15.372639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:15.380810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c45c77b6-a23e-439d-8b37-748b921d86cc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1723 microversion: 2.1 time: 0.207979 Oct 23 20:11:15.381300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 393/765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:15 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:15.406178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:15.415767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3d5f81b8-a9b2-40cc-bfe1-d984a588cae9 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.203269 Oct 23 20:11:15.416490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 373/766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:15 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:16.404023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:16.404627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:16.410993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:16.411466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:16.411894 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:16.412567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:16.413013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:16.413429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:16.438788 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:16.439407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:16.445925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:16.446455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:16.447143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:16.447834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:16.448289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:16.449199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:16.595685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:16.603697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-16146903-a183-4ec4-942e-95b1e9560bf7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1723 microversion: 2.1 time: 0.204132 Oct 23 20:11:16.604254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 394/767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:16 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:16.616900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:16.624551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-39f0aaca-840e-4d6e-abd2-ea98f2e5ab0c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.189515 Oct 23 20:11:16.625108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 374/768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:16 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:17.626685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:17.627391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:17.633720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:17.634199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:17.634667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:17.635346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:17.635796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:17.636710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:17.647391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:17.648006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:17.655183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:17.655702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:17.656147 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:17.656848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:17.657310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:17.657738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:17.825201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:17.827458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:17.835028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d507c908-f497-4f6a-9ff6-eb63b6cd38ec tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1723 microversion: 2.1 time: 0.212155 Oct 23 20:11:17.835646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 395/769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:17 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:17.835769 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:17.844237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-58099f2d-79f9-4b61-be69-5f1c53c1f114 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.200677 Oct 23 20:11:17.844790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 375/770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:17 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:18.858812 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:18.859345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:18.866704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:18.867193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:18.867449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:18.867844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:18.868057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:18.868338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:18.868797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:18.869219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:18.874346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:18.874826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:18.875254 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:18.875940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:18.876387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:18.876810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:19.060850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:19.067535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:19.069075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c4e6b405-c023-4051-98d7-541b18d2257b tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1729 microversion: 2.1 time: 0.214712 Oct 23 20:11:19.069641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 396/771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:18 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:19.076970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c078765c-ee75-4692-a046-4a428b36b78f tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1677 microversion: 2.1 time: 0.213155 Oct 23 20:11:19.077705 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 376/772] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:18 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:19.092039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:19.092523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:19.098344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:19.098833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:19.099275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:19.099966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:19.100425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:19.100850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:19.178840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f645106a-fe4e-4ff7-8625-d9299ec1e419 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090966 Oct 23 20:11:19.179569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 397/773] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:11:19 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:11:20.100930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:20.101539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:20.103965 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=47 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:20.109495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.110067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.110541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.111235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.111689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.112108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.318007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:20.327340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0a4c4848-4815-482f-8122-8faaed940813 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1654 microversion: 2.1 time: 0.230212 Oct 23 20:11:20.328487 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 377/774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:20 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1654 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:20.350893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:20.358133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.358934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.359368 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.382166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Going to try to start instance {{(pid=118866) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 20:11:20.400140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:20.406134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=46 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:20.410702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.411428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.411861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.424233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] Creating event network-changed:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:11:20.425894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1faa0c44-cbf5-45d2-b167-4d263d031781 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action" status: 202 len: 0 microversion: 2.1 time: 0.079671 Oct 23 20:11:20.426748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 378/775] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:11:20 2022] POST /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:11:20.432365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-8dbded9d-6a90-41f2-aea9-095c24c3ffde req-77c9b9ee-f1bc-4906-b008-d29551c67bee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104993 Oct 23 20:11:20.434466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 398/776] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:11:20.438668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:20.439374 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:20.445957 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.446506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.447286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.447918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:20.448584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:20.449031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:20.653425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:20.668071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f37db5bb-720f-4894-980a-3d028b9d3243 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1663 microversion: 2.1 time: 0.236276 Oct 23 20:11:20.669332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 379/777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:20 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:21.692607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:21.693294 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:21.699724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:21.700199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:21.700625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:21.701297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:21.701762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:21.702158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:21.828354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:21.835919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e40c95a1-466e-4dda-b21e-48c150a8e4e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1663 microversion: 2.1 time: 0.148036 Oct 23 20:11:21.836473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 399/778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:21 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:22.446874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:22.457404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:22.457877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:22.458326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:22.469367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] Creating event network-changed:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:11:22.474079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-e2b808f7-0073-4537-bca3-f9eba3181da0 req-bcd6e84d-8c25-4153-addf-c4630e455a96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030856 Oct 23 20:11:22.474664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 380/779] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:22.859929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:22.860547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:22.867953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:22.868666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:22.869110 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:22.869955 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:22.871209 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:22.871623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:23.043265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:23.051025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3d3678aa-3e9e-4ab0-a52f-bc9f728c91b6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1667 microversion: 2.1 time: 0.194899 Oct 23 20:11:23.051589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 400/780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:22 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1667 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:27.808200 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1713642150"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:27.808818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:27.814856 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:27.815335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:27.815762 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:27.816444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:27.816899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:27.817322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:27.945481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.network.security_group_api [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Removing security group cbda9d00-e98a-43c2-9d1f-4f2b50230b94 from port 5baa163f-fb98-46dd-88e4-27b50776e2f7 Oct 23 20:11:28.251445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-244410e3-e14a-411c-95f3-4b47130d879a tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action" status: 202 len: 0 microversion: 2.1 time: 0.448117 Oct 23 20:11:28.255491 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 381/781] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:11:27 2022] POST /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:11:28.262758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:28.274953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:28.275896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:28.277236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:28.289636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] Creating event network-changed:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:11:28.296082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-e3c6481b-2201-4452-91f7-ea883e8c9535 req-03659b04-c9d9-48c0-b93c-ced7269c4f8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038270 Oct 23 20:11:28.297077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 401/782] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:29.534398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:29.534915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:29.541124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:29.541675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:29.542790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:29.543553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:29.544072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:29.544562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:29.563294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:29.595914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:29.606759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:29.607246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:29.607679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:29.619073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] Creating event network-changed:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:11:29.624519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-7c4c8021-8b36-4c69-8b3a-fd87ce20a0c1 req-75dbe880-b34c-4b94-ad3f-6a7519e696e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091900 Oct 23 20:11:29.626415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 402/783] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:29.633080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lazy-loading 'services' on Instance uuid d5375465-162e-4d9d-affe-27a205b609f5 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:11:29.709205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b76e7327-2e9e-404c-8123-780795b11258 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments/d6185ce2-5bd6-4954-baf2-cdf56102ffb5" status: 202 len: 0 microversion: 2.1 time: 0.179186 Oct 23 20:11:29.713027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 382/784] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:11:29 2022] DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments/d6185ce2-5bd6-4954-baf2-cdf56102ffb5 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:11:29.722292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:29.724525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:29.736295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:29.736781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:29.737214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:29.737907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:29.738390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:29.738834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:29.775561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b457f3b6-17d5-4ccb-9468-9c88483f474b tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060571 Oct 23 20:11:29.776540 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 403/785] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:11:29 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:30.789565 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:30.791841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:30.797936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:30.798468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:30.798902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:30.799592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:30.800048 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:30.800473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:30.829079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-99d3dd73-0904-4bef-bd87-64958a7bdd37 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044521 Oct 23 20:11:30.829625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 383/786] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:11:30 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:11:30.840207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:30.840686 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:30.846980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:30.847455 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:30.847883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:30.848578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:30.849013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:30.849538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:30.922496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] HTTP exception thrown: Instance d5375465-162e-4d9d-affe-27a205b609f5 is not attached to volume d6185ce2-5bd6-4954-baf2-cdf56102ffb5 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Request method failure captured: Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments/d6185ce2-5bd6-4954-baf2-cdf56102ffb5 HTTP/1.1 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ7S3X9uzfmoAlSH858H_5xTONotnvLOj0RuRJxS6nwQ8oJsdRa2re8tf9gkTGIweP-w_wmWVaeo4NrRZ5Lcw1dN1kjLurq_zJxSJXffujzk-5qu1JhbsAtMClN7WE3D_yDNzf46I3rWNoYGX8yIblk8An_5MxHxfdDUZJ2zxlpiQek Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 6b4261a7b9e642e5ba063a4790296b66 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:11:30.932432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b4261a7b9e642e5ba063a4790296b66", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b4261a7b9e642e5ba063a4790296b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b4261a7b9e642e5ba063a4790296b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b4261a7b9e642e5ba063a4790296b66"}]}] Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 6b4261a7b9e642e5ba063a4790296b66 Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-TestMinimumBasicScenario-1849300538-project Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7d0a9c2670794fb4b134e261411fd9cb Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-TestMinimumBasicScenario-1849300538-project Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:11:30.934674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance d5375465-162e-4d9d-affe-27a205b609f5 is not attached to volume d6185ce2-5bd6-4954-baf2-cdf56102ffb5 Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'server_id': 'd5375465-162e-4d9d-affe-27a205b609f5', 'id': 'd6185ce2-5bd6-4954-baf2-cdf56102ffb5'} Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d6185ce2-5bd6-4954-baf2-cdf56102ffb5. Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:11:30.935544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5375465-162e-4d9d-affe-27a205b609f5 is not attached to volume d6185ce2-5bd6-4954-baf2-cdf56102ffb5 Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5375465-162e-4d9d-affe-27a205b609f5 is not attached to volume d6185ce2-5bd6-4954-baf2-cdf56102ffb5 Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:30.937031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Returning 404 to user: Instance d5375465-162e-4d9d-affe-27a205b609f5 is not attached to volume d6185ce2-5bd6-4954-baf2-cdf56102ffb5 {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:11:30.938138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-86dbaea4-0917-4840-9edf-4aa76d31fe67 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments/d6185ce2-5bd6-4954-baf2-cdf56102ffb5" status: 404 len: 154 microversion: 2.1 time: 0.098332 Oct 23 20:11:30.938138 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 404/787] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:11:30 2022] DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5/os-volume_attachments/d6185ce2-5bd6-4954-baf2-cdf56102ffb5 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:11:32.081582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:32.082110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:32.088365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:32.088885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:32.089825 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:32.090534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:32.090984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:32.091402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:32.115195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:11:32.188097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cea7996d-8012-4f69-8d0a-ae84999ebe17 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 204 len: 0 microversion: 2.1 time: 0.110069 Oct 23 20:11:32.188681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 384/788] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:11:32 2022] DELETE /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:11:32.197356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:32.199063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:32.205439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:32.205918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:32.206389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:32.207075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:32.207529 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:32.207967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:32.337097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:32.344768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ca91df68-d700-49c7-b2cc-d3295d3d6954 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1555 microversion: 2.1 time: 0.151704 Oct 23 20:11:32.345326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 405/789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:32 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:33.368126 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:33.368817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:33.375321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:33.375799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:33.376228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:33.376906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:33.377356 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:33.377776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:33.503802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:33.512234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6dd1bffd-9f1e-43c8-acaf-943b5453ee0e tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1555 microversion: 2.1 time: 0.148295 Oct 23 20:11:33.512791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 385/790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:33 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:34.534924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:34.535508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:34.542512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:34.543009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:34.543429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:34.544099 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:34.544547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:34.544961 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:34.766709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:34.774395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-62abc5c5-486e-497d-bbe6-25d2528b811d tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1555 microversion: 2.1 time: 0.243231 Oct 23 20:11:34.774955 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 406/791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:34 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:35.104072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5375465-162e-4d9d-affe-27a205b609f5", "name": "network-vif-deleted", "tag": "5baa163f-fb98-46dd-88e4-27b50776e2f7"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:35.114584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:35.115057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:35.115513 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:35.126860 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] Creating event network-vif-deleted:5baa163f-fb98-46dd-88e4-27b50776e2f7 for instance d5375465-162e-4d9d-affe-27a205b609f5 on hv-cinder-86243 Oct 23 20:11:35.132108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-e68e2fff-5feb-40b5-83f7-4028c3d7ed24 req-e8af1c4f-80bb-4526-a8f2-bfb271771cfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Oct 23 20:11:35.132817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 386/792] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:35.797402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:35.798007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:35.804057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:35.804545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:35.804977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:35.805675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:35.806130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:35.806579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:35.837957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:35.838492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:35.838960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:35.839446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lazy-loading 'fault' on Instance uuid d5375465-162e-4d9d-affe-27a205b609f5 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:11:35.886775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0a9c2670794fb4b134e261411fd9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4261a7b9e642e5ba063a4790296b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:35.895948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cca64bef-0e99-4caa-9746-724a0b0a4e89 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 200 len: 1349 microversion: 2.1 time: 0.102282 Oct 23 20:11:35.913204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 407/793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:35 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 1349 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:11:36.922698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:36.923512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] [instance: d5375465-162e-4d9d-affe-27a205b609f5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:36.929686 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:36.930162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:36.930620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:36.931308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:36.931758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:36.932171 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:36.945283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] HTTP exception thrown: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Request method failure captured: Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 HTTP/1.1 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ7S3X9uzfmoAlSH858H_5xTONotnvLOj0RuRJxS6nwQ8oJsdRa2re8tf9gkTGIweP-w_wmWVaeo4NrRZ5Lcw1dN1kjLurq_zJxSJXffujzk-5qu1JhbsAtMClN7WE3D_yDNzf46I3rWNoYGX8yIblk8An_5MxHxfdDUZJ2zxlpiQek Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 6b4261a7b9e642e5ba063a4790296b66 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:11:36.946950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6b4261a7b9e642e5ba063a4790296b66", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6b4261a7b9e642e5ba063a4790296b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b4261a7b9e642e5ba063a4790296b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6b4261a7b9e642e5ba063a4790296b66"}]}] Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 6b4261a7b9e642e5ba063a4790296b66 Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1849300538 Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-TestMinimumBasicScenario-1849300538-project Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 7d0a9c2670794fb4b134e261411fd9cb Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-TestMinimumBasicScenario-1849300538-project Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. Oct 23 20:11:36.948532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'd5375465-162e-4d9d-affe-27a205b609f5'} Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:11:36.949267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. Oct 23 20:11:36.950887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:11:36.952232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Returning 404 to user: Instance d5375465-162e-4d9d-affe-27a205b609f5 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:11:36.952232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b2773760-ae97-46ac-a6da-ceb0456c98eb tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5" status: 404 len: 111 microversion: 2.1 time: 0.030731 Oct 23 20:11:36.952232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 387/794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:11:36 2022] GET /compute/v2.1/servers/d5375465-162e-4d9d-affe-27a205b609f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:11:36.957640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-43139772-aef0-41e5-afb1-3f70f6de0814 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] Calling method '.version_select at 0x7f64f03888b0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:36.978710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-43139772-aef0-41e5-afb1-3f70f6de0814 tempest-TestMinimumBasicScenario-1849300538 tempest-TestMinimumBasicScenario-1849300538-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2077887482" status: 202 len: 0 microversion: 2.1 time: 0.024871 Oct 23 20:11:36.981713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 408/795] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 23 20:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2077887482 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:11:42.611121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:42.612326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:42.619757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:42.621216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:42.621890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:42.622873 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:42.623529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:42.624581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:42.666124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-913a3c12-a6e9-423a-9d1d-30f8630b9eb9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments/929e7185-0542-47cc-8a07-07713c720f1c" status: 200 len: 194 microversion: 2.20 time: 0.058984 Oct 23 20:11:42.668293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 388/796] 10.222.0.13 () {60 vars in 1454 bytes} [Sun Oct 23 20:11:42 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments/929e7185-0542-47cc-8a07-07713c720f1c => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:11:42.759984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:42.761150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:42.768533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:42.769355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:42.770005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:42.771005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:42.771869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:42.772526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:42.871430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lazy-loading 'services' on Instance uuid 4abcffff-127a-4a75-84a5-19e12536b4de {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:11:43.036229 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-087b6747-e7c7-4dbe-a60f-ebbb1843b089 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments/929e7185-0542-47cc-8a07-07713c720f1c" status: 202 len: 0 microversion: 2.20 time: 0.280126 Oct 23 20:11:43.037603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 409/797] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 23 20:11:42 2022] DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments/929e7185-0542-47cc-8a07-07713c720f1c => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:11:43.047668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:43.050293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:43.057065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:43.057746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:43.058304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:43.059117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:43.059812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:43.060449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:43.101230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c91408f3-d9df-44d0-a8c1-5ac4ec6bb9a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057849 Oct 23 20:11:43.102530 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 389/798] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 20:11:43 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:11:44.116708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:44.119052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:44.126171 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.126693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.127123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.127883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.128273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.128688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.162385 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-24cb9d5b-f555-4b89-ab4e-b9b968a74962 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050034 Oct 23 20:11:44.162956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 410/799] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 20:11:44 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:11:44.238331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:44.238861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:44.247300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.247863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.248361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.249124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.249669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.250154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.275083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:11:44.352834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dff8a7e2-fd1e-4372-96e0-00a11e9899d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 204 len: 0 microversion: 2.20 time: 0.118245 Oct 23 20:11:44.353850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 390/800] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 20:11:44 2022] DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 20:11:44.362329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:44.363084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:44.369349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.370385 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.371167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.371688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:44.372142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:44.372564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:44.508248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:44.516612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:44.518275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:44.519419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a7672cbf-bf0f-466c-a5d6-7b3dcbc7b8c5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.161069 Oct 23 20:11:44.519981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 411/801] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:44 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:45.549704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:45.550442 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:45.556780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:45.557331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:45.558303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:45.559044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:45.559507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:45.559936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:45.686702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:45.695552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:45.697982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:45.699326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-466d631a-83e4-4d5c-be54-83d0eac94063 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1724 microversion: 2.20 time: 0.154076 Oct 23 20:11:45.699888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 391/802] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:45 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:46.724878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:46.725482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:46.732556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:46.733313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:46.733953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:46.734682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:46.735297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:46.735719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:46.812518 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:46.820466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:46.821900 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:46.824032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c1a6f857-8955-4bd3-9799-e431feed1efb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 200 len: 1657 microversion: 2.20 time: 0.102947 Oct 23 20:11:46.824592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 412/803] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:46 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 1657 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:47.018190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abcffff-127a-4a75-84a5-19e12536b4de", "name": "network-vif-deleted", "tag": "5324bb33-be61-462e-b3ed-9373ad4fce7f"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:47.033655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:47.034156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:47.045226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:47.060324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] Creating event network-vif-deleted:5324bb33-be61-462e-b3ed-9373ad4fce7f for instance 4abcffff-127a-4a75-84a5-19e12536b4de on hv-cinder-86243 Oct 23 20:11:47.065321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-ddc3b4bd-71ef-4820-ba11-637e68ce8f87 req-2ac2e0a1-d0c0-4887-9e13-2029ac1b23f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052520 Oct 23 20:11:47.073325 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 392/804] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:11:47.849373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:47.851661 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:47.858418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:47.858902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:47.859327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:47.860008 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:47.860453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:47.860867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:47.864040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:47.876857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de HTTP/1.1 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:11:47.878498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:11:47.880221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '4abcffff-127a-4a75-84a5-19e12536b4de'} Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:11:47.881325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:11:47.882850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:11:47.884092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:11:47.884092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-86cf2e2b-7f9b-49d3-bbc4-863e0e73c3f3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 404 len: 111 microversion: 2.20 time: 0.034555 Oct 23 20:11:47.884092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 413/805] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:47 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:11:47.889848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9216329b-8df8-41de-b8cd-f8703d2f7fd5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '.version_select at 0x7f64f0247dc0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:47.894404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9216329b-8df8-41de-b8cd-f8703d2f7fd5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [8eb9bf2c-51da-4332-8661-b2d0c2523de3] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:11:48.903254 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [None req-9216329b-8df8-41de-b8cd-f8703d2f7fd5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [8eb9bf2c-51da-4332-8661-b2d0c2523de3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46662. Oct 23 20:11:48.921476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9216329b-8df8-41de-b8cd-f8703d2f7fd5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643625100" status: 204 len: 0 microversion: 2.20 time: 1.036294 Oct 23 20:11:48.922083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 393/806] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 23 20:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643625100 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 20:11:49.542569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f6dc5b01-2d3c-417c-abbb-4d211b82a210 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: .version_select at 0x7f64f04b7ca0>, body: {"keypair": {"name": "tempest-keypair-1988014208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXyOggkEBysf3J/oPMok4UhMqlT28M2zK7aLyoQNKaEwMeR3Cv/55R3Kjg08ol+4CCRdf+kt6gzg1mIIDo7MFOXadftQuMz18eZTzC38g76Rj50FQO03tGERwTZe9smMA=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:49.558023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-f6dc5b01-2d3c-417c-abbb-4d211b82a210 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for project 4023fb7431ad496fa044b19190f014d8. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:11:49.561790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-f6dc5b01-2d3c-417c-abbb-4d211b82a210 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for user 7cef68ee160348dea427e6c46b775e2d and project 4023fb7431ad496fa044b19190f014d8. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:11:49.583249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f6dc5b01-2d3c-417c-abbb-4d211b82a210 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045127 Oct 23 20:11:49.583827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 414/807] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 23 20:11:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 20:11:50.868846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1718113966", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d42fdacc-7ef9-4dc3-a526-50a70d71365d"}], "security_groups": [{"name": "tempest-securitygroup--1748466110"}], "key_name": "tempest-keypair-1988014208", "user_data": "}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:50.877280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:50.981692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] validate_networks() for [('d42fdacc-7ef9-4dc3-a526-50a70d71365d', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:11:51.432316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:11:51.432739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:11:51.433235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:11:51.433639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:11:51.434059 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:11:51.442785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:51.443266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:51.443695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:51.444413 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:51.444872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:51.445293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:51.463122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for project 4023fb7431ad496fa044b19190f014d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:11:51.467756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Getting quotas for user 7cef68ee160348dea427e6c46b775e2d and project 4023fb7431ad496fa044b19190f014d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:11:51.478664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:11:51.481063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:11:51.527461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-463fbb3c-25fb-46dc-ba6d-0ea7734654a3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.665759 Oct 23 20:11:51.528103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 394/808] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 23 20:11:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 20:11:51.539795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:51.540405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:51.542236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:51.597008 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:51.604607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:51.606536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:51.607994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7ceab9d3-ada0-4d58-8383-9fbac6603275 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1282 microversion: 2.20 time: 0.072774 Oct 23 20:11:51.608652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 415/809] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:51 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:52.632771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:52.633615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:52.640479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:52.640967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:52.641403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:52.642172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:52.642663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:52.643086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:52.705967 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:52.715050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:52.716506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:52.717612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1122e28d-4940-40a5-a216-95a83f03c768 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1334 microversion: 2.20 time: 0.089365 Oct 23 20:11:52.718168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 395/810] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:52 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:53.743684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:53.744289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:53.750964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:53.751521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:53.752021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:53.752797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:53.753391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:53.753895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:53.974018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:53.982139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:53.983675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:53.984805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a3271802-b27e-41b7-8026-1e0eeb4d108c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.245469 Oct 23 20:11:53.985361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 416/811] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:53 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:54.171439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:54.181400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:54.181870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:54.183042 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:54.195208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] Creating event network-changed:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:11:54.200737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-7b8aa5cf-5373-4040-becc-2f3eee605dbb req-94556be5-8a48-48ad-b1df-949f3d2e5145 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032978 Oct 23 20:11:54.201679 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 396/812] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:11:55.010419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:55.011025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:55.017473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:55.017956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:55.018419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:55.019113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:55.019566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:55.019987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:55.145418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:55.154084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:55.155571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:55.156659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-71bbf781-0b70-480b-9095-34573c34b158 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.150225 Oct 23 20:11:55.157211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 417/813] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:55 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:56.183222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:56.183922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:56.189998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:56.190510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:56.190944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:56.191628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:56.192080 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:56.192499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:56.321730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:56.330622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:56.332070 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:56.333168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d629d704-e19f-4e25-9651-dc678c5dc09a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.154821 Oct 23 20:11:56.333729 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 397/814] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:56 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:57.357523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:57.358133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:57.364337 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:57.364825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:57.365373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:57.366087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:57.366570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:57.366993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:57.535199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:57.543220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:57.544657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:57.545755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e4f09628-99a1-493e-90bf-56cee361b8a4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.192753 Oct 23 20:11:57.546347 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 418/815] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:57 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:58.570677 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:58.571290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:58.578532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:58.579021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:58.579461 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:58.580179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:58.580636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:58.581063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:58.707600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:58.715712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:58.717197 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:58.718362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a8a47eda-56b7-452a-a9db-f02054269bba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.151593 Oct 23 20:11:58.718920 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 398/816] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:58 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:59.743001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:11:59.744023 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:11:59.751494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:59.751970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:59.752399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:59.753080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:59.753527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:59.753936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:59.896927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:59.906905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:59.907916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "name": "network-vif-plugged", "status": "completed", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:11:59.908393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:11:59.909462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3a453ab0-d477-4daf-8165-b95b5108a3c0 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.170741 Oct 23 20:11:59.910046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 419/817] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:11:59 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:11:59.917193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:11:59.917662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:11:59.918084 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:11:59.920690 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:59.930483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] Creating event network-vif-plugged:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:11:59.935935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-b2fe9ced-3552-4f34-a1be-df6ac1b0be70 req-7763df87-b5f0-41d9-963d-69979a06aac0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160736 Oct 23 20:11:59.936516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 399/818] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:12:00.934027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:00.934658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:00.940975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:00.941456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:00.941894 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:00.942618 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:00.943072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:00.943491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:01.074719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:01.082775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:01.084205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:01.085278 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9dbd33d8-13db-4f10-a0f1-114c127e088a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1408 microversion: 2.20 time: 0.155111 Oct 23 20:12:01.085830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 420/819] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:12:00 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:12:02.108236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:02.108981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:02.113545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:02.114272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:02.122527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:02.123007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:02.123438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:02.124124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:02.124575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:02.124998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:02.250680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:02.258602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:02.260033 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:02.261176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2f655059-e62e-4aa0-b247-8b47b522a0ad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1601 microversion: 2.20 time: 0.154401 Oct 23 20:12:02.261733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 400/820] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:12:02 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:12:02.285555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:02.286069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:02.287995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:02.294013 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:02.294550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:02.294984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:02.295664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:02.296116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:02.296535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:02.370316 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5f5c48d9-224b-440b-8f40-63bf6a3510b4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088657 Oct 23 20:12:02.370910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 421/821] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 23 20:12:02 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:12:03.266495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:03.277104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:03.277587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:03.278020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:03.291107 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] Creating event network-changed:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:12:03.296499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-77bd2e54-3bcd-42bd-97dc-b571c1427e16 req-fea720c0-1579-4896-9ad8-5ddf145a56fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 Oct 23 20:12:03.297115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 401/822] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:18.445857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=15 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:18.446684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=35 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:18.451531 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:18.452016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:18.459054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:18.459533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:18.459956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:18.460655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:18.461101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:18.461516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:18.540525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'services' on Instance uuid 0850267f-8db1-4863-8a9f-661c2cba3304 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:12:18.613334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-332bc9b0-230f-4892-84a0-f396561df7fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments/573e31b1-e499-4e8f-a740-f65f41bc098f" status: 202 len: 0 microversion: 2.1 time: 0.169328 Oct 23 20:12:18.613910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 422/823] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:12:18 2022] DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments/573e31b1-e499-4e8f-a740-f65f41bc098f => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:12:18.621254 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:18.622057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=9 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:18.626659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:18.628623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:18.637222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:18.637981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:18.638707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:18.639322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:18.639774 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:18.640226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:18.673525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a771b42e-9cb8-4ad2-a5f2-80de972773d6 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054602 Oct 23 20:12:18.674092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 402/824] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:12:18 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:19.688083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:19.690526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:19.696663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.697158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.698141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:19.698862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.699320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.699743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:19.727865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-60f4b3de-c12a-4403-a01c-bc593e871948 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044698 Oct 23 20:12:19.728420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 423/825] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:12:19 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:12:19.803971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:19.804597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:19.811521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.812006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.812446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:19.813137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.813601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.814028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:19.839145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:12:19.936507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fb2b6624-5d04-4d0e-971e-4ea827fcc5be tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 204 len: 0 microversion: 2.1 time: 0.136153 Oct 23 20:12:19.937108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 403/826] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:12:19 2022] DELETE /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:12:19.945390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:19.945938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:19.952037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.952521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.952948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:19.953627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:19.954078 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:19.954527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:20.082403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:20.090237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0155f9a2-dc15-479e-a4c6-7615b5f4d5fe tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1689 microversion: 2.1 time: 0.148934 Oct 23 20:12:20.090838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 424/827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:19 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:21.114178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:21.114911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:21.121296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:21.121784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:21.122220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:21.122933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:21.123421 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:21.123848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:21.256371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:21.264118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5e91ce04-0414-4a5c-be3a-870490186d8e tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1689 microversion: 2.1 time: 0.154214 Oct 23 20:12:21.264694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 404/828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:21 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:22.287555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:22.288121 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:22.294940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.295422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.295851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.296528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.296984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.297401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.424932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:22.433250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bee85ac8-c02a-40f5-a13e-acd0de1e5d7f tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1689 microversion: 2.1 time: 0.149923 Oct 23 20:12:22.433826 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 425/829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:22 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:22.465695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:22.467874 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:22.474190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.474700 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.475160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.475836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.476289 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.476702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.504905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0d0d8dde-7c39-4bc1-9420-1b47bda756ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043702 Oct 23 20:12:22.505444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 405/830] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:12:22 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:12:22.567233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:22.567730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:22.573781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.574288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.574728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.575407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.575862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.576281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.600568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:12:22.673806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eef21b25-ea35-44af-849c-bdbf676d8180 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 204 len: 0 microversion: 2.1 time: 0.110089 Oct 23 20:12:22.674407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 426/831] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:12:22 2022] DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:12:22.682678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:22.683294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:22.689125 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.689609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.690042 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.690771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:22.691228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:22.691656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:22.821779 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:22.829766 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a5ae041b-51cd-4adc-b386-3e5b876bbc93 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1673 microversion: 2.1 time: 0.151036 Oct 23 20:12:22.830369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 406/832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:22 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:23.456992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:23.457670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:23.463972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:23.464447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:23.464878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:23.465563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:23.466016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:23.466490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:23.604388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:23.612052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f41289b5-d745-4614-8f4c-65a9994b7686 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1689 microversion: 2.1 time: 0.159423 Oct 23 20:12:23.612625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 427/833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:23 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:23.853270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:23.854639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:23.862459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:23.862953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:23.863607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:23.864389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:23.864995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:23.865423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:23.998728 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:24.007711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b4379c82-09b2-46b7-b43a-48c838e0feb5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1673 microversion: 2.1 time: 0.158438 Oct 23 20:12:24.008451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 407/834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:23 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:24.626494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:24.627090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:24.635572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.636352 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.636602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.637620 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.638201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.638758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.638964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:24.639551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:24.646665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.647239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.647688 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.648532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.649055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.649689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.671050 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lazy-loading 'flavor' on Instance uuid 8e395c64-fce7-4bf0-812f-97f145c32451 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:12:24.755045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-51e9f951-6c37-4c3a-80a6-97a551198746 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "POST /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451/action" status: 202 len: 0 microversion: 2.1 time: 0.132924 Oct 23 20:12:24.761480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 428/835] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:12:24 2022] POST /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:12:24.766688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:24.767391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:24.773518 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.774004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.774470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.775161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:24.775662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:24.776094 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:24.850223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:24.861154 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c15a7d96-6788-45aa-bd86-29834fbe07ed tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1689 microversion: 2.1 time: 0.228754 Oct 23 20:12:24.881412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 408/836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:24 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:24.986743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:24.995294 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cac401df-bfbc-4c8c-a01f-f0b49966d2e8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.232594 Oct 23 20:12:24.998427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 429/837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:24 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:25.030791 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:25.031409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:25.042311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.042810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.043246 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.043976 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.044434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.044862 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.280469 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:25.301220 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-00867d75-4350-4641-ac34-ae38c4cbf2cb tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1673 microversion: 2.1 time: 0.274180 Oct 23 20:12:25.322036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 409/838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:25 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1673 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:25.355713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0850267f-8db1-4863-8a9f-661c2cba3304", "name": "network-vif-deleted", "tag": "41b0684f-5781-4279-b8fc-b59c705a8861"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:25.367538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.368287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.368936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.381954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] Creating event network-vif-deleted:41b0684f-5781-4279-b8fc-b59c705a8861 for instance 0850267f-8db1-4863-8a9f-661c2cba3304 on hv-cinder-86243 Oct 23 20:12:25.388688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-5df84b7c-64b1-44e6-afa0-d547f62e6912 req-de1ff339-d3aa-4d95-8f03-736a94afa249 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036814 Oct 23 20:12:25.393759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 430/839] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:25.802619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3d6cd-5a81-425b-a929-808f46010e76", "name": "network-vif-deleted", "tag": "e989a766-0552-40b5-acf0-9a2d7f1dfe99"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:25.814371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.815041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.815673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.828904 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] Creating event network-vif-deleted:e989a766-0552-40b5-acf0-9a2d7f1dfe99 for instance 80f3d6cd-5a81-425b-a929-808f46010e76 on hv-cinder-86243 Oct 23 20:12:25.835557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-90f9f570-db9d-4b02-bf9a-b0f4b88964c1 req-45559ea1-eed0-49b5-94a1-4ff45b8db2eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037181 Oct 23 20:12:25.840384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 410/840] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:25.886684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:25.887399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:25.899683 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.902075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.902623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.903625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.904042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.906466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.974616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:25.975112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:25.975552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:25.976003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'fault' on Instance uuid 0850267f-8db1-4863-8a9f-661c2cba3304 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:12:26.019848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:26.020923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:26.037349 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:26.037963 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:26.038516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:26.039378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:26.039910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:26.040854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:26.053985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:26.067120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d0eb2ce0-fc0a-47a9-9c3f-be03fd110143 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 200 len: 1335 microversion: 2.1 time: 0.185741 Oct 23 20:12:26.068079 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 431/841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:25 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 1335 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:26.217184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:26.226416 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c705d575-6909-4e6f-b9f5-be7a2fc95464 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.210982 Oct 23 20:12:26.227225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 411/842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:26 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:26.349975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:26.350621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:26.359690 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:26.360190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:26.360809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:26.361517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:26.361981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:26.362440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:26.418671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:26.419177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:26.419618 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:26.420066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lazy-loading 'fault' on Instance uuid 80f3d6cd-5a81-425b-a929-808f46010e76 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:12:26.463648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:26.472483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-948eeb78-8598-4a14-bb0e-04aea6963e7a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 200 len: 1327 microversion: 2.1 time: 0.127878 Oct 23 20:12:26.473069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 432/843] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:26 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:27.088953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:27.089562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: 0850267f-8db1-4863-8a9f-661c2cba3304] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:27.095981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.096458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.096888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.097565 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.098016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.098471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.111302 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] HTTP exception thrown: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Request method failure captured: Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 HTTP/1.1 Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6GJSHS7PE_rhsH1AThlFNasoBL6ha9FEFafOtUV-zPBMkfti6CC_gtYVpttrReSsvhSG8Sv9lljUzzUEwxH2wrwtwzXMo3KdgVuHRXo1JEnupgg36Fgbv-_Qu2ZXTqiTCBzlv-Ax6p7bQdTfH3NOqRJIjQVlLCQvZ6gpdgW4Tzmkc Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:12:27.112922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41c21bcf4ca457391486c08565b2aae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}] Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 4b6a101d23df4b62ba7e0c35d28d2a3c Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. Oct 23 20:12:27.114559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '0850267f-8db1-4863-8a9f-661c2cba3304'} Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:12:27.115492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. Oct 23 20:12:27.116995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.118737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Returning 404 to user: Instance 0850267f-8db1-4863-8a9f-661c2cba3304 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:12:27.118737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-af027485-e290-4411-ac10-12f0bce27cef tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304" status: 404 len: 111 microversion: 2.1 time: 0.029309 Oct 23 20:12:27.118737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 412/844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:27 2022] GET /compute/v2.1/servers/0850267f-8db1-4863-8a9f-661c2cba3304 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:27.123519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e7fbf441-7f14-4aeb-9e2f-3659475fd778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '.version_select at 0x7f64f028f040>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:27.142225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e7fbf441-7f14-4aeb-9e2f-3659475fd778 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472134453" status: 202 len: 0 microversion: 2.1 time: 0.022952 Oct 23 20:12:27.142806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 433/845] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 20:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472134453 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:12:27.249629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:27.250292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:27.256150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.256689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.257224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.257953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.258465 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.258902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.415494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:27.424177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f62da531-3989-408b-b2cf-5f524920437c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.178407 Oct 23 20:12:27.424754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 413/846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:27 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:27.496153 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:27.496759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:27.503651 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.504134 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.504564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.505255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:27.505710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:27.506126 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:27.519869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 HTTP/1.1 Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:12:27.521612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:12:27.523257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '80f3d6cd-5a81-425b-a929-808f46010e76'} Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:12:27.524087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:12:27.525416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:27.527619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:12:27.527619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0fc6e66d-0ce4-40ef-ad2e-d7650be3e8c3 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 404 len: 111 microversion: 2.1 time: 0.030871 Oct 23 20:12:27.527619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 434/847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:27 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:27.532633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8d9ca935-a6c2-477c-9de5-ebbfa0f80b34 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '.version_select at 0x7f64f02b13a0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:27.551957 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8d9ca935-a6c2-477c-9de5-ebbfa0f80b34 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910178489" status: 202 len: 0 microversion: 2.1 time: 0.023078 Oct 23 20:12:27.552540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 414/848] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 20:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910178489 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:12:28.448349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:28.448959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:28.456964 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:28.457452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:28.457897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:28.458622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:28.459094 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:28.459527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:28.487985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-58e12ae0-856d-4e24-9196-fb231598c484 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: .version_select at 0x7f64f02938b0>, body: {"keypair": {"name": "tempest-keypair-1222833440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0M1I0T6Zi4aCgtLzILxPD3LnJqpPm5fLrRKeAn70cLdV0RDA9rMVlIsSJF9wNSdkswJi1cib2IODbZFgisRPl/COyaF/DlwnqMBzKMLAPBX5OuAnTwwuIZr88oGqrFcw=="}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:28.504629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-58e12ae0-856d-4e24-9196-fb231598c484 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:12:28.508746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-58e12ae0-856d-4e24-9196-fb231598c484 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for user 7aca00ea597140c5be97a6a4fa33f9c7 and project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:12:28.531193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-58e12ae0-856d-4e24-9196-fb231598c484 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047015 Oct 23 20:12:28.531795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 415/849] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:12:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:12:28.598968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:28.602546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:28.610427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a863e999-01ff-48b6-b843-37aa4921ba6b tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.166545 Oct 23 20:12:28.611264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 435/850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:28 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:29.636440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:29.637047 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:29.643163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:29.643648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:29.644078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:29.644815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:29.645258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:29.645682 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:29.780370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:29.788123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4a504141-d88d-44f7-be56-6c017db03fcd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.157139 Oct 23 20:12:29.788695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 416/851] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:29 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:30.055901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-247107898", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e3b82ee-7488-4576-9263-10150a8cce41"}], "security_groups": [{"name": "tempest-securitygroup--614667329"}], "key_name": "tempest-keypair-1222833440", "user_data": "}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:30.159501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] validate_networks() for [('8e3b82ee-7488-4576-9263-10150a8cce41', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:12:30.382095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:30.382590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:30.389275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.389715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.390149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.390875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.391332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.391754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.420710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:12:30.500949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-54dbdc42-e053-4491-a13f-f5701caf2841 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 204 len: 0 microversion: 2.1 time: 0.122206 Oct 23 20:12:30.501536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 417/852] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:12:30 2022] DELETE /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 20:12:30.511400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:30.512088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:30.517870 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.518405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.518836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.519520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.519968 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.520386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.538811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:30.633851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:12:30.634294 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:12:30.635316 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:12:30.635714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:12:30.636114 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:12:30.645839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.646446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.647103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.647827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.648288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.648704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.665819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:12:30.669791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Getting quotas for user 7aca00ea597140c5be97a6a4fa33f9c7 and project 5ebb0d7d16214912a585ca96cf6b2c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:12:30.678095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:30.680960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:12:30.683286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:12:30.686008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-46ff0f95-c2fc-45db-ab6c-0158f3166cb7 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1506 microversion: 2.1 time: 0.180222 Oct 23 20:12:30.686613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 418/853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:30 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:30.730090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d18abb68-5aa6-46fb-bbf0-5ab128a47820 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.679341 Oct 23 20:12:30.730811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 436/854] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:12:30.741997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-71a0d6d0-c0e5-479a-a779-2718c6e69f21 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:30.742644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-71a0d6d0-c0e5-479a-a779-2718c6e69f21 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:30.795422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-71a0d6d0-c0e5-479a-a779-2718c6e69f21 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:30.801735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-71a0d6d0-c0e5-479a-a779-2718c6e69f21 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1237 microversion: 2.1 time: 0.063579 Oct 23 20:12:30.802333 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 419/855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:30 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:30.813060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:30.813669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:30.820060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.820552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.820982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.821669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:30.822216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:30.823459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:30.958403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:30.969773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c8294433-82af-4849-9e50-64f38710916c tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.160441 Oct 23 20:12:30.970597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 437/856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:30 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:31.708799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:31.709419 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:31.715886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:31.716374 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:31.716814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:31.717505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:31.717962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:31.718422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:31.825679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:31.826313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:31.833101 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:31.833590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:31.834024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:31.834756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:31.835218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:31.835635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:31.853238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:31.861918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-810f4c8f-64b2-4859-a1d7-d486e0fba786 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1506 microversion: 2.1 time: 0.156972 Oct 23 20:12:31.862816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 420/857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:31 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:31.900737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:31.908305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ead639ea-fd64-4e4a-83f2-b0adb8d44ef6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1289 microversion: 2.1 time: 0.087650 Oct 23 20:12:31.908863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 438/858] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:31 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:31.993036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:31.993650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:32.000236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.000721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.001159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.001843 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.002320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.002746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.133331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:32.141057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2b60526a-3586-4550-92ab-b8cd15c3d54e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.152037 Oct 23 20:12:32.141634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 421/859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:31 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:32.712919 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea876cfc-08f7-40c4-bcd8-2b1f32738f30", "name": "network-vif-deleted", "tag": "41d3538a-ad99-4c35-a478-c0aa5c437554"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:32.724057 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.724825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.725420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.739771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] Creating event network-vif-deleted:41d3538a-ad99-4c35-a478-c0aa5c437554 for instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 on hv-cinder-86243 Oct 23 20:12:32.745694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-8593ccff-9912-4204-a163-e49ab127c907 req-73eadf95-bc24-4100-a524-561086a1cafd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037877 Oct 23 20:12:32.746636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 439/860] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:32.889380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:32.890151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:32.898556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.899099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.899822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.901150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.901681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.902227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.932942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:32.934618 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:32.941743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.942264 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.942829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.943486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.943739 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lazy-loading 'fault' on Instance uuid ea876cfc-08f7-40c4-bcd8-2b1f32738f30 {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:12:32.944020 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.944375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.945451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:32.946060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:32.946671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:32.991846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:33.001699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7c139003-5b83-4a24-89e2-da43060d8027 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 200 len: 1311 microversion: 2.1 time: 0.118314 Oct 23 20:12:33.021012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 422/861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:32 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:33.045420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:33.054154 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c3c34fb3-c7c9-43be-8fee-6c8533d38b86 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1295 microversion: 2.1 time: 0.125393 Oct 23 20:12:33.054935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 440/862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:32 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:33.163398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:33.164571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:33.173850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:33.174582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:33.175027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:33.175733 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:33.176352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:33.176842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:33.316683 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:33.325925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ef5bb0e1-f456-4736-84de-76772024bc9d tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.166393 Oct 23 20:12:33.326730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 423/863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:33 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:33.957024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d97f22e-44b3-48cf-b17e-8ace7a5d67dc", "tag": "c63cc4c4-cffa-4b0e-b0ee-c912548afbac"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:33.967751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:33.968243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:33.968676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:33.985021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] Creating event network-changed:c63cc4c4-cffa-4b0e-b0ee-c912548afbac for instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc on hv-cinder-86243 Oct 23 20:12:33.989984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-6d9e4a71-4d52-4ff3-becd-087eae002625 req-c75ccaed-fcd8-4a1f-8061-3ad3376e331d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036724 Oct 23 20:12:33.990628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 441/864] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:34.029538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:34.030156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: ea876cfc-08f7-40c4-bcd8-2b1f32738f30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:34.036661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.037152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.037594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.038404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.038869 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.039872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.054667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] HTTP exception thrown: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Request method failure captured: Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 HTTP/1.1 Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6GJSHS7PE_rhsH1AThlFNasoBL6ha9FEFafOtUV-zPBMkfti6CC_gtYVpttrReSsvhSG8Sv9lljUzzUEwxH2wrwtwzXMo3KdgVuHRXo1JEnupgg36Fgbv-_Qu2ZXTqiTCBzlv-Ax6p7bQdTfH3NOqRJIjQVlLCQvZ6gpdgW4Tzmkc Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:12:34.056339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41c21bcf4ca457391486c08565b2aae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}] Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 4b6a101d23df4b62ba7e0c35d28d2a3c Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. Oct 23 20:12:34.057741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'ea876cfc-08f7-40c4-bcd8-2b1f32738f30'} Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:12:34.058767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. Oct 23 20:12:34.060307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:12:34.061680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Returning 404 to user: Instance ea876cfc-08f7-40c4-bcd8-2b1f32738f30 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:12:34.061680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-45d8b867-446e-4a38-930f-769f589b1d23 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30" status: 404 len: 111 microversion: 2.1 time: 0.032754 Oct 23 20:12:34.061680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 424/865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:34 2022] GET /compute/v2.1/servers/ea876cfc-08f7-40c4-bcd8-2b1f32738f30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:34.066987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:34.067580 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:34.074003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.074542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.075359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.076063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.076522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.077143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.080715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:34.081409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:34.087422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.088405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.088836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.089529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.089976 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.090612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.104184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:12:34.180809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-68d4b36d-ed26-4e36-ba31-7f57879611f0 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "DELETE /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 204 len: 0 microversion: 2.1 time: 0.117614 Oct 23 20:12:34.181857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 442/866] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:12:34 2022] DELETE /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:12:34.191474 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:34.192218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:34.198845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.199518 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.199759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.200450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.200908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.201331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.308131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:34.315970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-feea8369-3741-4c08-8daa-7c8c6a462e76 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.239457 Oct 23 20:12:34.316579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 425/867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:34 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:34.349454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:34.350157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:34.356454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.356692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:34.356941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.357376 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.358069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:34.358549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:34.359008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:34.364834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-48c47a01-51ec-4038-8ca6-ecab480578e1 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.178817 Oct 23 20:12:34.365496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 443/868] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:34 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:34.486924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:34.495054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-78ad56bf-1047-433c-af51-08276f65acff tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.150105 Oct 23 20:12:34.495614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 426/869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:34 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:35.340391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:35.341007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:35.347344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.347824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.348248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.348922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.349368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.349783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.387723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:35.388336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:35.395025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.395510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.395987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.396712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.397162 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.397582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.528782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:35.536407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-359e3178-fe12-4ca0-83e9-ef7c4e192ced tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.200295 Oct 23 20:12:35.536995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 444/870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:35 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:35.542052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:35.542676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:35.548325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.548793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.549402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.550087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:35.550573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:35.550996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:35.555290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:35.562994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9856b1eb-ed05-4a82-86e9-9bcdfc453ae4 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.179170 Oct 23 20:12:35.563568 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 427/871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:35 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:35.676683 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:35.684364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-65521d2c-5d7e-40b1-b77d-b729aa09abc2 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.146430 Oct 23 20:12:35.684936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 445/872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:35 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:36.560868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:36.561483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:36.568058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.568540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.569011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.569701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.570159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.570609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.585396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:36.585997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:36.593026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.593535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.593963 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.594670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.595124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.595538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.760652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:36.768388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dc8cd0ae-4902-4d95-9d5e-d4a28b9f12d8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.211428 Oct 23 20:12:36.769066 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 428/873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:36 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:36.771981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:36.773595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:36.774205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:36.779940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.780425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.780861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.780975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-530c0e2b-d66d-483c-be5a-47f1e892af20 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.199235 Oct 23 20:12:36.781555 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:36.782279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 446/874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:36 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:36.782423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:36.782689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:36.909676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:36.917372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-77f70cac-b377-477e-b5dc-8767fc1e2534 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.147363 Oct 23 20:12:36.917948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 429/875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:36 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:37.791829 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:37.792365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:37.799005 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:37.799482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:37.799988 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:37.800733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:37.801190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:37.801761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:37.804034 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:37.804643 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:37.811946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:37.812451 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:37.812885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:37.813576 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:37.814031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:37.814489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:37.996153 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:38.000082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:38.003773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9241a891-c10e-4d65-8678-4f3615ebe67c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.216314 Oct 23 20:12:38.004337 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 447/876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:37 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:38.007718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-69b6a1c0-c229-4358-b593-f6f29c6d6900 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1521 microversion: 2.1 time: 0.207581 Oct 23 20:12:38.008462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 430/877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:37 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:38.009151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:38.009799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:38.019003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:38.019878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:38.020475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:38.021282 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:38.021876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:38.022446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:38.150979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:38.158665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-07b9cda6-46bd-416e-ac78-43699dea568e tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.153082 Oct 23 20:12:38.159238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 448/878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:38 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:39.033834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:39.034488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:39.041102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:39.041726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:39.043040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.043926 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.046908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.047722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.048374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.048539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.048843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.049212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.049340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.050024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.050513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.050945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.146083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:39.153923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5c8335b5-67e9-4d01-89f1-f1ff629f6b1d tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1479 microversion: 2.1 time: 0.126959 Oct 23 20:12:39.154534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 449/879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:39 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1479 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:39.159006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8837d8-442b-4b75-b896-e07e4a04391f", "name": "network-vif-deleted", "tag": "2157f124-6d4c-4aa3-8b95-ee304dc9379e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:39.168622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.169112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.169544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.180641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] Creating event network-vif-deleted:2157f124-6d4c-4aa3-8b95-ee304dc9379e for instance df8837d8-442b-4b75-b896-e07e4a04391f on hv-cinder-86243 Oct 23 20:12:39.186279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-44886aac-f002-4d3d-8965-29dd9a6580cd req-abe21d9f-6d40-4f1c-905b-786140a762e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 Oct 23 20:12:39.186882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 450/880] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:39.191948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:39.192641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:39.199430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.199914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.200346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.201034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:39.201489 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:39.201914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:39.216214 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:39.223702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-56ad4e64-442e-4d6f-899a-c187f1c842a8 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.200377 Oct 23 20:12:39.224267 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 431/881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:39 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:39.330765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:39.338663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-94cd4e18-2c52-4e44-ae11-34f1a5439cd9 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.150587 Oct 23 20:12:39.339233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 451/882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:39 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:40.176756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:40.177369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:40.183982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.184413 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.184848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.185535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.185998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.186469 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.245621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:40.246235 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:40.250170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a101d23df4b62ba7e0c35d28d2a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41c21bcf4ca457391486c08565b2aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:40.253497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.254204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.254672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.255364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.255950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.256372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.258357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1bc79e6b-7ac9-4d4c-9a4d-6965039c0edc tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 200 len: 1307 microversion: 2.1 time: 0.085469 Oct 23 20:12:40.265696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 432/883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:40 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:40.362272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:40.362890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:40.369414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.369913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.370390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.371092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:40.371611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:40.371972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:40.393640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:40.407184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6e313b77-40d2-414d-b87d-892853063c7e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.165408 Oct 23 20:12:40.408014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 452/884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:40 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:40.526669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:40.534659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6c880937-9075-4184-9efe-82a6bc17ac06 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.176181 Oct 23 20:12:40.535236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 433/885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:40 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:41.284243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:41.285195 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] [instance: df8837d8-442b-4b75-b896-e07e4a04391f] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:41.287497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.288365 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.296025 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.296516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.297000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.297688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.298144 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.298596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.313523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] HTTP exception thrown: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Request method failure captured: Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f HTTP/1.1 Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6GJSHS7PE_rhsH1AThlFNasoBL6ha9FEFafOtUV-zPBMkfti6CC_gtYVpttrReSsvhSG8Sv9lljUzzUEwxH2wrwtwzXMo3KdgVuHRXo1JEnupgg36Fgbv-_Qu2ZXTqiTCBzlv-Ax6p7bQdTfH3NOqRJIjQVlLCQvZ6gpdgW4Tzmkc Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:12:41.315248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41c21bcf4ca457391486c08565b2aae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41c21bcf4ca457391486c08565b2aae"}]}] Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: e41c21bcf4ca457391486c08565b2aae Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805229211 Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 4b6a101d23df4b62ba7e0c35d28d2a3c Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805229211-project Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. Oct 23 20:12:41.316606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'df8837d8-442b-4b75-b896-e07e4a04391f'} Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:12:41.317370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. Oct 23 20:12:41.318560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:12:41.320206 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] Returning 404 to user: Instance df8837d8-442b-4b75-b896-e07e4a04391f could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:12:41.320206 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ff561a73-4f4d-47e1-a532-2268e62b6d92 tempest-ServerRescueNegativeTestJSON-1805229211 tempest-ServerRescueNegativeTestJSON-1805229211-project] 10.222.0.13 "GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f" status: 404 len: 111 microversion: 2.1 time: 0.037185 Oct 23 20:12:41.320206 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 453/886] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:41 2022] GET /compute/v2.1/servers/df8837d8-442b-4b75-b896-e07e4a04391f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:41.430050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:41.430695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:41.433586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.438190 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.438704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.439144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.439850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.440308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.440731 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.557776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:41.558420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:41.562091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.565806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.566315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.566766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.567457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.567904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.568319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.573953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.692237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:41.700720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-054ad992-48f7-473e-89f5-fa0dc7d9df9b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.274396 Oct 23 20:12:41.701399 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 434/887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:41 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:41.795804 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:41.804454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ea513e17-03a9-4e6a-a724-4f1221971593 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1511 microversion: 2.1 time: 0.250505 Oct 23 20:12:41.805277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 454/888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:41 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:41.831218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:41.832013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:41.839519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.840009 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.840443 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.841134 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.841590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.842011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.886554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118866) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 20:12:41.896722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.930935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.955435 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-096462ae-6564-485b-97a3-58fe2a58ca14 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "POST /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451/action" status: 202 len: 0 microversion: 2.1 time: 0.128844 Oct 23 20:12:41.956410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 435/889] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 23 20:12:41 2022] POST /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:12:41.964996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:41.965606 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:41.975957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.976324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.976810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:41.977510 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:41.978105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:41.978586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:42.146088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d97f22e-44b3-48cf-b17e-8ace7a5d67dc", "name": "network-vif-plugged", "status": "completed", "tag": "c63cc4c4-cffa-4b0e-b0ee-c912548afbac"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:42.166345 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:42.167219 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:42.167891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:42.181199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] Creating event network-vif-plugged:c63cc4c4-cffa-4b0e-b0ee-c912548afbac for instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc on hv-cinder-86243 Oct 23 20:12:42.187745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-ae373428-6889-48b4-ade8-4058243252df req-9c004850-8acc-48b8-9e4b-0e697edd6eaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045282 Oct 23 20:12:42.189175 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 436/890] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:42.583275 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:42.592190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b66d89a7-c151-435c-9267-daa8e435fb40 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1519 microversion: 2.1 time: 0.631926 Oct 23 20:12:42.592878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 455/891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:41 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1519 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:42.726213 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:42.726933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:42.733653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:42.734137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:42.734706 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:42.735515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:42.736061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:42.736570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:42.927713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:42.936642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6546c1c8-4c69-484e-a691-c6e446a054ba tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.215234 Oct 23 20:12:42.937459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 437/892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:42 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:43.619739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:43.620504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:43.629538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:43.634139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:43.636907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:43.637917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:43.638514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:43.639430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:43.827086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:43.836249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-894d5210-c528-46a1-9a01-574b1b23e36a tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1521 microversion: 2.1 time: 0.222575 Oct 23 20:12:43.837552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 456/893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:43 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:43.961483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:43.962838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:43.969422 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:43.970605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:43.971282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:43.972188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:43.972833 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:43.973680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:44.149629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:44.161789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5a45f524-0d9a-4ff3-80a4-1cc7c5fdec1d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1362 microversion: 2.1 time: 0.204639 Oct 23 20:12:44.162400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 438/894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:43 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:44.227320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "name": "network-vif-unplugged", "status": "completed", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:44.240360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:44.241265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:44.241857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:44.256331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.compute.server_external_events [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] Unable to find a host for instance 8e395c64-fce7-4bf0-812f-97f145c32451. Dropping event network-vif-unplugged {{(pid=118867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 20:12:44.257485 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-2eec6d09-c58c-495a-b662-0483518dcd58 req-98c8f23e-34da-4299-8019-907f48a2d446 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035727 Oct 23 20:12:44.258709 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 457/895] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 20:12:44.861277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:44.861910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:44.868165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:44.868901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:44.869582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:44.870498 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:44.870956 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:44.871543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:45.107485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:45.120541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a6d85004-d1da-4827-ae29-ed52050d2bdb tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.262973 Oct 23 20:12:45.121868 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 439/896] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:44 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:45.191720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:45.193348 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:45.207252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:45.207883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:45.208621 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:45.211522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:45.212120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:45.213689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:45.471017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:45.479711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-80ac6426-cb2b-44b3-9524-b8603d852632 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1548 microversion: 2.1 time: 0.297566 Oct 23 20:12:45.480670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 458/897] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:45 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1548 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:45.502342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:45.503076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:45.509052 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:45.510068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:45.510534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:45.511232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:45.511689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:45.512111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:45.629439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cabc677b-96b4-4e92-9886-897c3526764d tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130901 Oct 23 20:12:45.637729 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 440/898] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:12:45 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:46.143983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:46.144597 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:46.151253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:46.151743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:46.152177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:46.152877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:46.153332 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:46.153755 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:46.302538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:46.310592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a7869c8a-a6db-4ad0-8701-dc7747d95a49 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.170336 Oct 23 20:12:46.311469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 459/899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:46 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:46.953763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d97f22e-44b3-48cf-b17e-8ace7a5d67dc", "tag": "c63cc4c4-cffa-4b0e-b0ee-c912548afbac"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:46.973043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:46.973665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:46.974152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:46.989571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] Creating event network-changed:c63cc4c4-cffa-4b0e-b0ee-c912548afbac for instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc on hv-cinder-86243 Oct 23 20:12:46.996446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-5378f681-eb1a-459d-9a62-7f59b1bd87d6 req-51caa97e-d963-4375-886d-fa27b44d1ec5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Oct 23 20:12:46.997135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 441/900] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:47.335238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:47.335971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:47.342553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:47.343045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:47.343712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:47.344582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:47.345039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:47.345868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:47.701610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:47.710425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-66d7e4cb-dc31-4ed1-a13e-94fcac1b0edd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.378858 Oct 23 20:12:47.721542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 460/901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:47 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:48.737303 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:48.738014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:48.745041 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:48.745544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:48.746211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:48.747021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:48.747481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:48.747911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:48.883763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:48.892252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2f73c186-7f82-43f5-843d-c61cec19f346 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.159393 Oct 23 20:12:48.892839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 442/902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:48 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:49.915949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:49.917169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:49.926703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:49.927885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:49.928542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:49.929473 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:49.930183 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:49.930840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:50.153819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:50.162428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2368bbf1-ae50-4f3f-b642-533fcfdcda98 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.250303 Oct 23 20:12:50.171340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 461/903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:49 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:12:51.186485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:51.186857 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:51.195641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:51.196259 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:51.196850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:51.199071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:51.199756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:51.200667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:51.355039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:51.364771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f7224d85-1489-4418-9c34-953ed37354cf tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.183306 Oct 23 20:12:51.365495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 443/904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:51 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:51.544753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-10c10eef-adb5-42f5-9e2c-8f93aeb128b5 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: .version_select at 0x7f64f0253280>, body: {"keypair": {"name": "tempest-keypair-1164896437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR7ebP4EjAo2hhQEf9zjb/+M+8xch8VSXN6asv9i7p7ZqS7bxO38Z54O2a/CzIQZqbG49PJe3/t++Mjjte8UAO4gURRNQjO9IsRN+zQsKTkAA6thrf0uIZg4jScXiTOJA=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:51.560045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-10c10eef-adb5-42f5-9e2c-8f93aeb128b5 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:12:51.564158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-10c10eef-adb5-42f5-9e2c-8f93aeb128b5 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:12:51.589086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-10c10eef-adb5-42f5-9e2c-8f93aeb128b5 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172614 Oct 23 20:12:51.589693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 462/905] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:12:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:52.388949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:52.389616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:52.395742 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:52.396223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:52.396649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:52.397337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:52.397786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:52.398203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:52.640820 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:52.649950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-df8a6583-ba5d-4d2c-a6f5-889a63841433 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.265325 Oct 23 20:12:52.650648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 444/906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:52 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:52.975122 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1474237624", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d505897-a26b-4ba1-98e0-a78acd4b7259"}], "security_groups": [{"name": "tempest-securitygroup--1603902056"}], "key_name": "tempest-keypair-1164896437", "user_data": "}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:53.088730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] validate_networks() for [('5d505897-a26b-4ba1-98e0-a78acd4b7259', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:12:53.474696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:12:53.475505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:12:53.476163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:12:53.476863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:12:53.477530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:12:53.488082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:53.488562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:53.489290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:53.490015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:53.490507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:53.490929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:53.507271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:12:53.511250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:12:53.522158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:12:53.524475 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:12:53.571954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3ce51f7a-3c79-4c7c-9f53-b0d1e7d233c8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601778 Oct 23 20:12:53.572872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 463/907] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:12:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:12:53.583858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-33360145-f1b9-4cfd-8d5f-067439ef82d0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:53.584470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-33360145-f1b9-4cfd-8d5f-067439ef82d0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:53.656201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-33360145-f1b9-4cfd-8d5f-067439ef82d0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:53.663294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-33360145-f1b9-4cfd-8d5f-067439ef82d0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1242 microversion: 2.1 time: 0.083225 Oct 23 20:12:53.664068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 445/908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:53 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:53.675590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:53.676199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:53.683848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:53.684808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:53.685311 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:53.686086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:53.686627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:53.687279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:53.844522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:53.852907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-81a2cf71-d024-4851-85cc-7d2a35363d92 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.181221 Oct 23 20:12:53.853925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 464/909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:53 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:54.686806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:54.687357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:54.697768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:54.698879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:54.699966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:54.701036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:54.701708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:54.702496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:54.832415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:54.847950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-415a64f6-e330-4829-92d5-093c65646041 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1302 microversion: 2.1 time: 0.165377 Oct 23 20:12:54.848563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 446/910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:54 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1302 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:54.876722 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:54.877985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:54.885818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:54.886601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:54.887225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:54.887938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:54.888394 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:54.888819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:55.054918 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:55.066699 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7ce62da9-ee4e-4007-a77e-29f1f1317ec8 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.193831 Oct 23 20:12:55.067280 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 465/911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:54 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:55.871239 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:55.871852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:55.878458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:55.878947 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:55.879408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:55.880277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:55.880734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:55.881157 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:56.075091 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:56.083510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f15592dc-24c5-45a0-b6aa-8b7b133bc243 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.216652 Oct 23 20:12:56.084099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 447/912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:55 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:56.091746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:56.091746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:56.106261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:56.106835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:56.107648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:56.108845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:56.109460 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:56.110032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:56.224053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "name": "network-vif-plugged", "status": "completed", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:56.236730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:56.237231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:56.237668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:56.249063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] Creating event network-vif-plugged:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:12:56.254210 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-515579a6-501e-4400-944e-f76d892d268e req-9b25db56-1491-4fef-99fe-30b8db116895 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Oct 23 20:12:56.254907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 448/913] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:12:56.322490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:56.330608 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-605ed0aa-1282-4bbd-b966-a9207d0ea794 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.244409 Oct 23 20:12:56.331185 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 466/914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:56 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:56.454277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdda865-b8ca-4233-b550-d4c6a3127e61", "tag": "347c96fd-ea12-48fc-8e67-96489156f197"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:12:56.464292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:56.464845 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:56.465340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:56.475772 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] Creating event network-changed:347c96fd-ea12-48fc-8e67-96489156f197 for instance cbdda865-b8ca-4233-b550-d4c6a3127e61 on hv-cinder-86243 Oct 23 20:12:56.481358 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-7b5f577f-5a57-462a-8631-4dfaa31c4ef5 req-9df463ff-09c6-427f-b7fd-e612765611ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Oct 23 20:12:56.481827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 449/915] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:12:57.105950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:57.106752 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:57.113770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:57.114270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:57.114809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:57.115495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:57.115941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:57.116354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:57.248716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:57.256470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a7345474-8c86-4bc8-8e0f-8a5ec1d14ef1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.154314 Oct 23 20:12:57.257067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 467/916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:57 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:57.355816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:57.356671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:57.363008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:57.363226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:57.363661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:57.364361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:57.364817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:57.365238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:57.493408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:57.501745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d8721552-ad34-4a8b-a18b-24bf33ebd1a3 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.151282 Oct 23 20:12:57.502332 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 450/917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:57 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:58.279902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:58.280500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:58.286821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:58.287295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:58.287718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:58.288392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:58.288837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:58.289250 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:58.417896 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:58.425356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bd85f68b-5142-482d-a5f2-2c926fe554ce tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.149822 Oct 23 20:12:58.425916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 468/918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:58 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:58.524773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:58.525384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:58.531982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:58.532457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:58.532883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:58.533566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:58.534014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:58.534457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:58.660570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:58.668202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ed622208-f435-4171-918d-6dd64e4114dc tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.147168 Oct 23 20:12:58.668707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 451/919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:58 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:59.447577 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:59.448440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:59.454924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:59.455407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:59.455836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:59.456514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:59.456966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:59.457383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:59.585699 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:59.594271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d8f23354-f7aa-4640-b4fa-8d22786a2218 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.150554 Oct 23 20:12:59.594846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 469/920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:59 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:12:59.691567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:12:59.692201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:12:59.699415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:59.699817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:59.700241 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:59.700924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:12:59.701387 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:12:59.701789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:12:59.832581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:12:59.840932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3729f9c1-43b8-464b-96ed-8a35dffe0ca4 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1577 microversion: 2.1 time: 0.153248 Oct 23 20:12:59.841500 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 452/921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:12:59 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:00.616587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:00.617306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:00.624233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:00.624717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:00.625147 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:00.625834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:00.626305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:00.626727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:00.760735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:00.768387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1ee40344-8780-4d7f-9e89-d442dd753460 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.155630 Oct 23 20:13:00.768949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 470/922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:00 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:00.865051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:00.865626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:00.872023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:00.872543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:00.872979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:00.873672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:00.874130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:00.874587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:01.004246 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:01.012137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1c8733ed-f326-456d-8b6f-567428c25e10 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1564 microversion: 2.1 time: 0.151091 Oct 23 20:13:01.012715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 453/923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:00 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:01.791486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:01.792027 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:01.798928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:01.799400 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:01.799822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:01.800496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:01.800941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:01.801357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:01.927227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:01.935311 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-005757a5-ffe5-42fc-9d5f-37e7c9e915c6 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.147769 Oct 23 20:13:01.935881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 471/924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:01 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:02.227994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdda865-b8ca-4233-b550-d4c6a3127e61", "name": "network-vif-plugged", "status": "completed", "tag": "347c96fd-ea12-48fc-8e67-96489156f197"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:02.238420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:02.238900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:02.239341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:02.250309 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] Creating event network-vif-plugged:347c96fd-ea12-48fc-8e67-96489156f197 for instance cbdda865-b8ca-4233-b550-d4c6a3127e61 on hv-cinder-86243 Oct 23 20:13:02.255036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-75adf05a-1894-41a7-bdbf-247c76c08e22 req-f7c27d53-bb26-4934-85b2-5c9632157e3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 Oct 23 20:13:02.255673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 454/925] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:13:02.959656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:02.960267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:02.966593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:02.967080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:02.967514 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:02.968197 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:02.968654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:02.969077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:03.100967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:03.108471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6044723b-9913-48f4-86f0-5dafc0dcb162 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.152738 Oct 23 20:13:03.109035 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 472/926] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:02 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:04.129174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:04.133477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:04.134176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:04.140964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:04.141439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:04.141865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:04.142634 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:04.143082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:04.143498 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:04.271295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:04.280506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a0cc51a8-d279-49b2-a6bc-56489e6df7bb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1368 microversion: 2.1 time: 0.152701 Oct 23 20:13:04.281082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 455/927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:04 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:05.303188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:05.303796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:05.305640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:05.306317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=10 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:05.312713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:05.313210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:05.313624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:05.314335 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:05.314791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:05.315213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:05.319169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=100 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:05.705974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:05.713658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-af7e0e56-ac8c-4af0-91ed-9c61750ff49e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1559 microversion: 2.1 time: 0.414342 Oct 23 20:13:05.714260 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 473/928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:13:05 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1559 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:13:05.736211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:05.736697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:05.743067 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:05.743544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:05.743974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:05.744687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:05.745137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:05.745558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:05.819941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f1b46fb8-fc43-49ef-b619-6c2c89be7421 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087499 Oct 23 20:13:05.820536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 456/929] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:13:05 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:13:06.711030 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdda865-b8ca-4233-b550-d4c6a3127e61", "tag": "347c96fd-ea12-48fc-8e67-96489156f197"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:06.721637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:06.721864 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:06.722320 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:06.733862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] Creating event network-changed:347c96fd-ea12-48fc-8e67-96489156f197 for instance cbdda865-b8ca-4233-b550-d4c6a3127e61 on hv-cinder-86243 Oct 23 20:13:06.739071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-f5ae5f14-2e6d-4de4-89e3-bab5ed085c10 req-b3e4797c-ee96-4f6c-b24b-2edbb1ac38b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031630 Oct 23 20:13:06.739664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 474/930] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:13:18.273165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=44 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:18.273888 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:18.278213 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:18.278727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:18.287283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:18.287764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:18.288195 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:18.288876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:18.289330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:18.289754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:18.313028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-842daaad-2aed-4db6-8842-3580071ef151 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/ips" status: 200 len: 152 microversion: 2.20 time: 0.041396 Oct 23 20:13:18.313594 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 457/931] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 23 20:13:18 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 20:13:20.346923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:20.347669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:20.351908 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:20.352556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:20.359640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:20.360123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:20.360555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:20.361239 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:20.361693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:20.362116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:20.385031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lazy-loading 'flavor' on Instance uuid 4c84c8bb-0374-4379-a0a7-c1531ae5b10e {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:13:20.570638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-10f4cb3b-2315-4b24-8597-7148444a3fb1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/action" status: 202 len: 0 microversion: 2.20 time: 0.225103 Oct 23 20:13:20.571376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 475/932] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 20:13:20 2022] POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:13:20.579508 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:20.580207 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:20.587123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:20.587778 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:20.588347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:20.589140 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:20.589612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:20.590132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:20.724348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:20.732840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:20.734311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:20.735466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6f11fc61-54fd-4a02-8571-745bea321406 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.159869 Oct 23 20:13:20.736014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 458/933] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:20 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:21.762036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:21.762756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:21.770209 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:21.770712 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:21.771137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:21.771839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:21.772286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:21.772699 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:21.904954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:21.913040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:21.914519 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:21.915666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-150d37e3-18d6-4342-a9b5-6c36ecad4e44 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.158297 Oct 23 20:13:21.916221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 476/934] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:21 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:22.940754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:22.941386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:22.947994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:22.948840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:22.949272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:22.949952 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:22.950431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:22.950848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:23.082540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:23.090681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:23.092113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:23.093268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-27e75380-8426-4d13-9e56-ba9d9badcd6c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.156467 Oct 23 20:13:23.093852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 459/935] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:22 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:24.118454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:24.119058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:24.125397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:24.125868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:24.126318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:24.126993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:24.127442 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:24.127855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:24.252929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:24.260829 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:24.262270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:24.263441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1cc01452-e90e-4f3e-ace6-25b1c6db3ed4 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.148912 Oct 23 20:13:24.263996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 477/936] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:24 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:25.290404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:25.291015 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:25.297892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:25.298401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:25.298834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:25.299518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:25.299970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:25.300391 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:25.432201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:25.440304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:25.441675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:25.442872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8bcf6e85-8104-4c72-ba26-2213f8209a0a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.156519 Oct 23 20:13:25.443431 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 460/937] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:25 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:26.468317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:26.468912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:26.475465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:26.475945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:26.476372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:26.477049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:26.477497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:26.477912 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:26.603786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:26.612509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:26.613981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:26.615201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8d95723e-5eac-4d18-bd1e-9c6479ece9ae tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.150742 Oct 23 20:13:26.615790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 478/938] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:26 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:27.641556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:27.642168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:27.648585 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:27.649068 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:27.649505 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:27.650191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:27.650670 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:27.651093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:27.847364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:27.855684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:27.857131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:27.858366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1567ce83-c7fd-4c17-9358-35e29accb85a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.221295 Oct 23 20:13:27.858891 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 461/939] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:27 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:28.885871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:28.886498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:28.893313 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:28.893818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:28.894263 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:28.894954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:28.895405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:28.895824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:29.020582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:29.028942 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:29.030420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:29.031566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d13cfcf8-807f-442d-a635-edbcf857e3c1 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.149628 Oct 23 20:13:29.032766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 479/940] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:28 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:30.057557 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:30.058170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:30.064811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:30.065290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:30.065886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:30.066615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:30.067075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:30.067500 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:30.197012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:30.205752 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:30.207218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:30.208394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-08a2b7a2-152e-40ec-a564-247311943073 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.154946 Oct 23 20:13:30.209117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 462/941] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:30 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:31.234306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:31.234906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:31.241322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:31.241791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:31.242216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:31.242910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:31.243354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:31.243766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:31.370054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:31.378733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:31.380174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:31.381323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e2c3ab8b-7a6a-4251-915c-dbf2fdf0cac7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.150937 Oct 23 20:13:31.381920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 480/942] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:31 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:32.407798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:32.408434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:32.414966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:32.415447 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:32.415879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:32.416569 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:32.417022 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:32.417444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:32.545927 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:32.553919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:32.555408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:32.556562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f2946029-b15b-4ebf-a179-1647e0acac63 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.153250 Oct 23 20:13:32.557133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 463/943] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:32 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:33.582501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:33.583113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:33.589488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:33.589975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:33.590443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:33.591127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:33.591582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:33.592006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:33.716301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:33.724886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:33.726356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:33.727505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4f35de8a-4c5c-4d9c-a0a2-597535f475cc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.149030 Oct 23 20:13:33.728064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 481/944] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:33 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:34.753996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:34.754674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:34.761076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:34.761559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:34.761993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:34.762713 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:34.763172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:34.763600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:34.889479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:34.897566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:34.899043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:34.900199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0e6cb6b9-e5fd-43d1-9af1-091ab4c7ce3c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.150806 Oct 23 20:13:34.900755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 464/945] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:34 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:35.925843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:35.926466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:35.933019 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:35.933497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:35.933920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:35.934637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:35.935084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:35.935497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:36.066923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:36.075373 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:36.076867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:36.078053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cc6bd215-ac1a-4eea-9d62-0968ef0f5c29 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.156155 Oct 23 20:13:36.078642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 482/946] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:35 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:37.103654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:37.104257 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:37.110671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:37.111160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:37.111589 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:37.112275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:37.112726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:37.113148 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:37.241583 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:37.249626 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:37.251104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:37.252258 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-48703f35-ba6d-485e-9ffe-421a2ada79ee tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.152537 Oct 23 20:13:37.252815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 465/947] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:37 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:38.277033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:38.277568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:38.284469 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:38.284950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:38.285383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:38.286052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:38.286613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:38.287041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:38.416982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:38.424941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:38.426629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:38.427780 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-026a02df-5b6f-4aa7-a79d-c4ede33bcc92 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.154771 Oct 23 20:13:38.428333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 483/948] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:38 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:39.453633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:39.454216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:39.461179 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:39.461660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:39.462092 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:39.462809 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:39.463266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:39.463720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:39.593595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:39.601684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:39.603150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:39.604365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b7f4e805-e309-4b53-9a01-4730768919fb tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.154661 Oct 23 20:13:39.604921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 466/949] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:39 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:40.417604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "name": "network-vif-plugged", "status": "completed", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:40.428085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:40.428635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:40.429072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:40.440367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] Creating event network-vif-plugged:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:13:40.445233 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-d1f922f9-d50b-4a29-88d2-b0ecadcee6ea req-66d914cb-03e8-44f2-a7e3-209dfa29d66e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031388 Oct 23 20:13:40.445826 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 484/950] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:13:40.628949 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:40.629588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:40.636159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:40.636641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:40.637069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:40.637758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:40.638210 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:40.638659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:40.761897 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:40.770439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:40.771882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:40.773035 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e58633e6-22df-4a43-a537-da25bff1b9ba tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.148019 Oct 23 20:13:40.773590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 467/951] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:40 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:41.800736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:41.801346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:41.807731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:41.808219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:41.808658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:41.809353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:41.809816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:41.810323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:41.941546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:41.949796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:41.951264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:41.952416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f307b126-a804-408e-b863-6107707bb8ff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.157317 Oct 23 20:13:41.952980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 485/952] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:41 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:42.981798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:42.982454 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:42.989433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:42.989914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:42.990393 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:42.991081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:42.991534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:42.991955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:43.117412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:43.125452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:43.126930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:43.128703 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b8359dfd-c22f-4caf-9339-7737c048fbef tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.150850 Oct 23 20:13:43.129266 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 468/953] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:42 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:44.154028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:44.154663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:44.160572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:44.161056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:44.161491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:44.162180 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:44.162662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:44.163083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:44.295901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:44.304004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:44.305446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:44.306687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d6b731c8-05ab-4436-8e43-d28894dd89f5 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1746 microversion: 2.20 time: 0.156689 Oct 23 20:13:44.307244 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 486/954] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:44 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:45.332730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:45.334221 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:45.341010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:45.341487 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:45.341913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:45.342627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:45.343078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:45.343521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:45.507343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:45.517300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:45.519675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:45.520983 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b38f7076-d15d-495f-aeac-0409dcf92744 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.192735 Oct 23 20:13:45.521981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 469/955] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:45 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:13:46.553458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:46.554055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:46.560705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:46.561195 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:46.561625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:46.562569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:46.563024 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:46.563652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:46.705457 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:46.715113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:46.716923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:46.718192 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2b9b268f-59ad-40df-8031-e3a207e6b956 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.168677 Oct 23 20:13:46.719033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 487/956] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:46 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:47.747051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:47.748338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:47.760218 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:47.761016 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:47.761803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:47.762901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:47.763543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:47.764347 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:47.926400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:47.935050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:47.936763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:47.938063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bd49e138-aaf3-4f0f-ad41-5cdcee9e6d74 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.195313 Oct 23 20:13:47.938792 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 470/957] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:47 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:13:48.966766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:48.968295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:48.975818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:48.976401 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:48.976921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:48.977759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:48.978302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:48.978793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:49.111737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:49.121397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:49.123276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:49.124657 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-55676838-f77c-418a-82c3-efb078700ba9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.161925 Oct 23 20:13:49.138572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 488/958] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:48 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:50.150276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:50.150877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:50.153163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=29 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:50.158917 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:50.160002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:50.160430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:50.161119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:50.161566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:50.161983 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:50.165247 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=83 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:50.298800 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:50.306915 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:50.308373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:50.309538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cd62d353-9ae9-49a9-9c4c-69a7f16a1dff tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.164029 Oct 23 20:13:50.310434 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 471/959] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:50 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:51.338383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:51.339093 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:51.342279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=29 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:51.350855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:51.351648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:51.352314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:51.353218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:51.353675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:51.354102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:51.357069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:51.500129 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:51.510383 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:51.512298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:51.513719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5a72fdb8-28e7-4740-bdf2-9a894fca4f4a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.182498 Oct 23 20:13:51.514520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 489/960] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:51 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:52.540916 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:52.541527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:52.548392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:52.548910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:52.549339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:52.550562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:52.551061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:52.551522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:52.688977 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:52.697440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:52.699253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:52.700430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-666657e0-b30f-4026-8dd2-537e9f262b6b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.163473 Oct 23 20:13:52.714264 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 472/961] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:52 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:53.726036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:53.726650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:53.733361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:53.733853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:53.734336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:53.735063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:53.735658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:53.736207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:53.892224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:53.920067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:53.921679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:53.923300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f4dc18f2-36e6-4483-a6bd-e4c81106e922 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.201712 Oct 23 20:13:53.939105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 490/962] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:53 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:54.949250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:54.950651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:54.957519 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:54.958012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:54.958475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:54.959164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:54.959617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:54.960060 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:55.105261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:55.113628 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:55.115614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:55.116780 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-781d260d-2fd4-45d9-b268-c8ad0b0a9213 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1741 microversion: 2.20 time: 0.171681 Oct 23 20:13:55.117341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 473/963] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:54 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:56.140892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:56.141501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:56.147950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:56.148434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:56.148865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:56.149558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:56.150012 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:56.150482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:56.344095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:56.352751 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:56.354207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:56.355392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-795fd727-963a-495d-a13c-9848bcc4e1bc tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1723 microversion: 2.20 time: 0.218391 Oct 23 20:13:56.355954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 491/964] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:56 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:57.381439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:57.382055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:57.388463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:57.388948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:57.389426 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:57.390123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:57.390617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:57.391045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:57.514719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:57.522676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:57.524120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:57.525277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-46212d69-5ce4-40d9-825d-38114529cb27 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1723 microversion: 2.20 time: 0.148324 Oct 23 20:13:57.525842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 474/965] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:57 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:58.550501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:58.551111 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:58.557957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:58.558471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:58.558904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:58.559586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:58.560080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:58.560490 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:58.960911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:58.968885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:58.970344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:58.971494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2fba3150-fe11-43a0-98c8-c639cdb193aa tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1726 microversion: 2.20 time: 0.424865 Oct 23 20:13:58.972069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 492/966] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:58 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1726 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:13:58.996342 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ff25018-715a-4422-bbc9-41e76bf7d1d3"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:58.998832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:59.006429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.006911 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.007343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.008029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.008485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.008909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.266082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fee44da1-a434-4657-bce3-49f641390923 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273767 Oct 23 20:13:59.266736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 475/967] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 23 20:13:58 2022] POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 20:13:59.393724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:59.394213 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:59.400140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.400652 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.401105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.401785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.402239 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.402682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.628417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5d59d365-b673-4918-90f1-4c1269cc89af tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments/5ff25018-715a-4422-bbc9-41e76bf7d1d3" status: 202 len: 0 microversion: 2.20 time: 0.238549 Oct 23 20:13:59.629808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 493/968] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 23 20:13:59 2022] DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments/5ff25018-715a-4422-bbc9-41e76bf7d1d3 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:13:59.690633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:13:59.691222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:59.697076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.697551 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.697973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.698689 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.699392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.699808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.728922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118866) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 20:13:59.792997 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-520c1123-1350-4cb7-b84a-678e4ccf3c85 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/action" status: 202 len: 0 microversion: 2.20 time: 0.106359 Oct 23 20:13:59.793601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 476/969] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 23 20:13:59 2022] POST /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:13:59.801881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:13:59.803081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:13:59.809937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.810743 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.811271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.812048 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:13:59.812561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:13:59.813051 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:13:59.943282 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:59.951681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:59.953112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:13:59.954277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ccedc631-8b97-4a68-a662-683f40549c46 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1674 microversion: 2.20 time: 0.156454 Oct 23 20:13:59.954838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 494/970] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:13:59 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:00.544128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "name": "network-vif-unplugged", "status": "completed", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:00.554348 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:00.554835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:00.555403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:00.568021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.compute.server_external_events [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] Unable to find a host for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e. Dropping event network-vif-unplugged {{(pid=118866) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 20:14:00.568889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-0dcab84b-1626-42fb-b579-35768e66927d req-4a898450-0caf-4b43-b75c-9ec62d5f9afa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029173 Oct 23 20:14:00.569488 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 477/971] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 20:14:00.979411 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:00.979999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:00.986353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:00.986828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:00.987279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:00.987960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:00.988403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:00.988816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:01.177836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:01.186793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:01.188258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:01.189412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7ade1583-b43a-47c6-bdc5-4822c6b21681 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.213920 Oct 23 20:14:01.189975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 495/972] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:00 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:02.215724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:02.216352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:02.223265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:02.224707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:02.225310 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:02.226186 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:02.226827 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:02.227413 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:02.264358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:02.264933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:02.272274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:02.273125 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:02.273793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:02.274742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:02.275398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:02.276017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:02.304177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a8e27fbf-fdc0-4b7c-8ea7-2e59d1c2baaf tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/ips" status: 200 len: 146 microversion: 2.1 time: 0.043581 Oct 23 20:14:02.311696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 496/973] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:14:02 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:14:02.383224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:02.400480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:02.402392 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:02.403905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-92ff1ec0-f075-4681-bf35-a05846f80a69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.192291 Oct 23 20:14:02.405063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 478/974] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:02 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:03.432655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:03.433359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:03.439682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:03.440166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:03.440766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:03.441462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:03.441911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:03.442357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:03.588160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:03.596812 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:03.598288 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:03.599407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ac60aa8f-0bb2-4c69-9eaa-141a25520157 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.170681 Oct 23 20:14:03.599959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 497/975] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:03 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:03.670562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10e412b8-5ce2-463d-aee1-73bdb8e8022f"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:03.673032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:03.679662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:03.680149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:03.680584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:03.681277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:03.681732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:03.682159 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:04.625123 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:04.625740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:04.632341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:04.632822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:04.633253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:04.633937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:04.634425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:04.634847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:04.762654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:04.771684 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:04.773175 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:04.775344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5b65fbdb-259b-4c34-99a9-674217a73e69 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.153327 Oct 23 20:14:04.786021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 498/976] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:04 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:05.801194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:05.801872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:05.808649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:05.809128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:05.809556 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:05.810237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:05.810715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:05.811135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:05.952541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:05.960827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:05.962339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:05.963487 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-812881dd-c166-406e-a2e1-c35a920b7db2 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.166314 Oct 23 20:14:05.964039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 499/977] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:05 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:06.989139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:06.989789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:06.996179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:06.996656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:06.997083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:06.997765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:06.998229 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:06.998651 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:07.125542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:07.134031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:07.135507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:07.136635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f48f2019-e92f-4109-a166-566038c797be tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.151472 Oct 23 20:14:07.137189 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 500/978] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:06 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:08.160883 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:08.162207 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:08.169886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:08.170720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:08.171216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:08.172151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:08.172607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:08.173029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:08.306095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:08.314061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:08.315563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:08.316706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-406ddbdc-b70b-467a-9f09-658ad130805e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.159709 Oct 23 20:14:08.317271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 501/979] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:08 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:09.342055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:09.342721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:09.348952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:09.349427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:09.349852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:09.350633 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:09.351081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:09.351994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:09.510004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:09.517935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:09.519392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:09.520526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-17f894d3-fe1f-4712-a768-a3752b0dbaed tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.182317 Oct 23 20:14:09.521083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 502/980] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:09 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:10.546271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:10.546996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:10.555536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:10.556036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:10.556526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:10.557356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:10.557878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:10.558449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:10.583627 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:10.708818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:10.716876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:10.718323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:10.719464 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0bb8f7dc-1cd4-4363-b2ba-48a4fa9367f9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.177318 Oct 23 20:14:10.720011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 503/981] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:10 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:11.745578 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:11.746458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:11.752766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:11.753254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:11.753685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:11.754405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:11.754864 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:11.755287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:11.912132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:11.920907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:11.922480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:11.924268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e6132ec4-02f5-40ac-880a-1a1e0f88f2ce tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.182626 Oct 23 20:14:11.926419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 504/982] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:11 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:12.955613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:12.956343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:12.962895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:12.963371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:12.963793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:12.964470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:12.964915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:12.965329 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:13.095793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:13.105654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:13.107194 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:13.108778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-97609723-f1b4-42c4-82bd-e0876d52b76b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.157294 Oct 23 20:14:13.109468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 505/983] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:12 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:13.677124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:13.758584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:14.134635 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:14.135241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:14.141491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:14.141962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:14.142424 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:14.143097 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:14.143542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:14.143956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:14.280045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:14.288675 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:14.290118 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:14.291332 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b7dbe131-f1df-495f-bf88-082c433f56e7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.160548 Oct 23 20:14:14.291901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 506/984] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:14 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:15.316929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:15.317504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:15.324247 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:15.324731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:15.325161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:15.325848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:15.326341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:15.326753 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:15.454802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:15.463181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:15.464636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:15.465767 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3b4973a5-6076-403c-8457-9304e64709b7 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.152909 Oct 23 20:14:15.466346 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 507/985] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:15 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:16.491430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:16.492650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:16.498983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:16.499458 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:16.499879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:16.500551 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:16.500997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:16.501412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:16.625465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:16.633319 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:16.634766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:16.635891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-11bb264c-625b-4f4c-9251-b3f133c07952 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.148421 Oct 23 20:14:16.636444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 508/986] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:16 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:17.660300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:17.660972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:17.667824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:17.668302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:17.668724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:17.669395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:17.669840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:17.670264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:17.800614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:17.808768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:17.810211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:17.811361 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-69b4c040-57bf-4d4a-b5c3-20b0869d92d6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.154962 Oct 23 20:14:17.811921 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 509/987] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:17 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:18.837581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:18.838221 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:18.844498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:18.844969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:18.845395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:18.846063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:18.846539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:18.846952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:18.972843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:18.980786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:18.982212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:18.983375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-15db23df-93f1-4a9c-8778-4573e47058f6 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.150358 Oct 23 20:14:18.983936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 510/988] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:18 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 20:14:19.903079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9b094c11-6928-427b-9f30-aa593d4b6926 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.236460 Oct 23 20:14:19.903978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 479/989] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:14:03 2022] POST /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 194 bytes in 16238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:20.008602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:20.009228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:20.015596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:20.016079 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:20.016508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:20.017201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:20.017834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:20.018276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:20.149302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:20.157225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:20.158682 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:20.159814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-115664ae-bd5a-42d0-9581-69f3e118295c tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.155659 Oct 23 20:14:20.160367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 511/990] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:20 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:21.187544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:21.188242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:21.195198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:21.195680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:21.196106 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:21.196795 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:21.197244 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:21.197661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:21.326613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:21.334578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:21.336015 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:21.337170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e2dff2ff-db78-42b3-8300-8e9fdb8cc1b9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.154628 Oct 23 20:14:21.337740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 480/991] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:21 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:22.362951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:22.363555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:22.365863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=46 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:22.371107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:22.371587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:22.372014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:22.372704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:22.373150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:22.373568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:22.506325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:22.515112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:22.516550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:22.517727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ecc95ec9-60b2-4161-86ab-c64404a6a626 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.158666 Oct 23 20:14:22.518339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 512/992] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:22 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:22.659017 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "name": "network-vif-plugged", "status": "completed", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:22.669671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:22.670160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:22.670702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:22.681788 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] Creating event network-vif-plugged:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:14:22.686664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-ff6dab3e-149f-41c8-aa35-cdb895795c50 req-1595ea3b-97c5-4f9d-8353-c86c2c9f9ee2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031367 Oct 23 20:14:22.687346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 481/993] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:23.545585 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:23.546230 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:23.552381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:23.552856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:23.553279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:23.553954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:23.555107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:23.555527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:23.685300 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:23.693391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:23.694877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:23.696015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ef40eb0c-f8ee-4434-8498-8256955beed3 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.154392 Oct 23 20:14:23.696599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 513/994] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:23 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:24.723388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:24.724211 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:24.732480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:24.732958 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:24.733380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:24.734095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:24.734719 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:24.735168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:24.873834 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:24.882923 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:24.884256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:24.885582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-932667a8-bd47-449d-b5c9-5e14cc5a1d2e tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1732 microversion: 2.20 time: 0.167000 Oct 23 20:14:24.886367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 482/995] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:24 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:25.910217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:25.910858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:25.917281 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:25.917754 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:25.918179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:25.918877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:25.919331 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:25.919745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:26.048176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:26.057112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:26.058574 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:26.059707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a1b225f9-bf1c-47dc-9f84-99863137bf6d tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1719 microversion: 2.20 time: 0.153424 Oct 23 20:14:26.060255 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 514/996] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:14:25 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:14:27.439344 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:27.441571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:27.448492 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:27.449010 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:27.449697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:27.450444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:27.450899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:27.451321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:27.480043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5d54f46d-3f4c-4e2f-b6e5-9e44f68422d1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Oct 23 20:14:27.480592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 483/997] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:14:27 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:27.491254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:27.492385 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:27.499064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:27.499549 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:27.499984 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:27.500674 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:27.501136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:27.501559 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:27.530697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-49bad402-be0c-4693-898b-e5aa0a8f618b tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f" status: 200 len: 194 microversion: 2.1 time: 0.043323 Oct 23 20:14:27.531268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 515/998] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 20:14:27 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:28.858852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad7e04c7-9ef1-4c66-814a-2c25feb4724e"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:28.861351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:28.868358 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:28.868971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:28.870152 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:28.870872 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:28.871365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:28.871793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:29.115750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-71f6db61-e790-4536-9e05-9788c0d07b48 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "POST /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260683 Oct 23 20:14:29.116341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 484/999] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:14:28 2022] POST /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:36.416066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:36.416565 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:36.423827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.424368 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.424805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.425484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.425937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.426382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.450982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a0f679b4-14db-4cb7-a0ab-36d8c361a0c0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/ips" status: 200 len: 151 microversion: 2.1 time: 0.038727 Oct 23 20:14:36.451471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 516/1000] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:14:36 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:36.653037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:36.656233 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:36.663894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.664776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.664902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.665688 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.666203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.666821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.701410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b9eaec4d-b8bc-4b29-85a9-b40c94694fd1 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054297 Oct 23 20:14:36.702450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 485/1001] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:14:36 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:36.841853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:36.842958 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:36.848935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.849414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.850181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.850911 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.851369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.851791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.881528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-57f4ca4d-44e5-458e-a024-6486c9fff9f6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f" status: 200 len: 194 microversion: 2.1 time: 0.043617 Oct 23 20:14:36.882438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 517/1002] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 20:14:36 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:36.893415 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:36.894062 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:36.901378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.901866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.902317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.903007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:36.903460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:36.903901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:36.985525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lazy-loading 'services' on Instance uuid 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:14:37.066075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cf3bf761-d830-4f77-9181-c78541645767 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f" status: 202 len: 0 microversion: 2.1 time: 0.177107 Oct 23 20:14:37.066695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 486/1003] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:14:36 2022] DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/10e412b8-5ce2-463d-aee1-73bdb8e8022f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:14:37.861246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157fb728-c596-449d-b934-0b989c8bc5fb"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:37.863758 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:37.870659 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:37.871142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:37.871582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:37.872276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:37.872735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:37.873158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.152459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c407b53b-e28e-4906-bbfb-66e8b7171458 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295686 Oct 23 20:14:38.153316 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 518/1004] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:14:37 2022] POST /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:38.597436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:38.598119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:38.604311 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:38.618001 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:38.618389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:38.618590 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:38.618882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:38.619007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.619317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.619783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:38.620298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:38.620721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.623366 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:38.633040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] Creating event network-changed:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:14:38.641234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-10d49752-ec08-4735-861f-110b2d3669e5 req-35a7d728-06fb-4740-8af5-91257db31252 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041231 Oct 23 20:14:38.642146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 519/1005] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:38.656232 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:14:38.743043 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b1ad4bdd-5919-4a1a-8863-7a57bc0b7491 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 204 len: 0 microversion: 2.1 time: 0.150357 Oct 23 20:14:38.748149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 487/1006] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:14:38 2022] DELETE /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:14:38.754933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:38.756467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:38.764632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:38.765124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:38.765557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.766509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:38.767146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:38.767573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:38.921098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:38.928898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-44fb3c2b-380d-4124-b10d-964116e9f343 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.178395 Oct 23 20:14:38.929467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 520/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:38 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:39.260018 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:39.260622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:39.266966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.267378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.267805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:39.268494 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.268944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.269364 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:39.300932 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2b59e439-6fed-48a1-afc9-ff12cb0cdfb6 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/ad7e04c7-9ef1-4c66-814a-2c25feb4724e" status: 200 len: 194 microversion: 2.1 time: 0.045373 Oct 23 20:14:39.301720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 488/1008] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 23 20:14:39 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/ad7e04c7-9ef1-4c66-814a-2c25feb4724e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:39.313617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:39.314708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:39.323128 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.323607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.324809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:39.325503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.326647 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.327076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:39.415969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lazy-loading 'services' on Instance uuid 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:14:39.493412 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-23487072-e927-4a7d-a427-9734b649d83e tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/ad7e04c7-9ef1-4c66-814a-2c25feb4724e" status: 202 len: 0 microversion: 2.1 time: 0.184740 Oct 23 20:14:39.494035 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 521/1009] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:14:39 2022] DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments/ad7e04c7-9ef1-4c66-814a-2c25feb4724e => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:14:39.953414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:39.954032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:39.960176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.960666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.961106 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:39.961809 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:39.962288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:39.962721 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:40.165974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:40.173723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7cc57580-afa6-482c-aec2-09cea91932dd tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1570 microversion: 2.1 time: 0.224981 Oct 23 20:14:40.174312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 489/1010] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:39 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:40.908066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e395c64-fce7-4bf0-812f-97f145c32451", "name": "network-vif-deleted", "tag": "b0cc60ca-61c3-4d14-93ce-439ad242dc02"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:40.921034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:40.921422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:40.921844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:40.933340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] Creating event network-vif-deleted:b0cc60ca-61c3-4d14-93ce-439ad242dc02 for instance 8e395c64-fce7-4bf0-812f-97f145c32451 on hv-cinder-86243 Oct 23 20:14:40.938061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-eed87dc8-bfca-426f-94f9-1892ea7b25d8 req-c6f3fbe4-fc54-4e5c-a913-2b2cd4329a48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034931 Oct 23 20:14:40.938693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 522/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:41.197507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:41.198168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:41.205884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:41.207414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:41.207858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:41.208572 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:41.209037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:41.209466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:41.295704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fac7ecf4f2435483df150292a0052b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84aaa230cf14fd2b47b2076e43fcb73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:41.303786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d037bef0-5118-403d-b6dc-7a47a0e5b609 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 200 len: 1220 microversion: 2.1 time: 0.110526 Oct 23 20:14:41.311130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 490/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:41 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:42.327017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:42.327708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] [instance: 8e395c64-fce7-4bf0-812f-97f145c32451] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:42.333770 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:42.334263 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:42.334700 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:42.335372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:42.335819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:42.336232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:42.349581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] HTTP exception thrown: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Request method failure captured: Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 HTTP/1.1 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ9hLGnMZ5_9EieFP6gkDswZXNwwrfyDNCM2UtPq3jWXJOEhveVlVXVEIjiXEAD9s4JUtETGUeuTCcPPQn0b8ZLWxgoBp0zf8QGNScuiibVevEe_EJS9xPzZjb7IN1-Qr7QpPfMkJ3qbEbU0nDmWGYQwIwBn6Btb81_m107qgzOGFhI Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: f84aaa230cf14fd2b47b2076e43fcb73 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-TestShelveInstance-1195271865 Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:14:42.351184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f84aaa230cf14fd2b47b2076e43fcb73", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f84aaa230cf14fd2b47b2076e43fcb73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f84aaa230cf14fd2b47b2076e43fcb73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f84aaa230cf14fd2b47b2076e43fcb73"}]}] Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-TestShelveInstance-1195271865 Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: f84aaa230cf14fd2b47b2076e43fcb73 Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-TestShelveInstance-1195271865 Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-TestShelveInstance-1195271865-project Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 21fac7ecf4f2435483df150292a0052b Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-TestShelveInstance-1195271865-project Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. Oct 23 20:14:42.352789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '8e395c64-fce7-4bf0-812f-97f145c32451'} Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:42.353726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. Oct 23 20:14:42.355350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:42.356689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Returning 404 to user: Instance 8e395c64-fce7-4bf0-812f-97f145c32451 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:42.356689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a4cd2751-320c-4069-a367-db84fe5c3300 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451" status: 404 len: 111 microversion: 2.1 time: 0.030563 Oct 23 20:14:42.356689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 523/1013] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:42 2022] GET /compute/v2.1/servers/8e395c64-fce7-4bf0-812f-97f145c32451 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:42.515886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-003e6d07-2ae7-42e3-acc0-643a5e10eb60 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] Calling method '.version_select at 0x7f64f04e21f0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:42.535412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-003e6d07-2ae7-42e3-acc0-643a5e10eb60 tempest-TestShelveInstance-1195271865 tempest-TestShelveInstance-1195271865-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509594046" status: 202 len: 0 microversion: 2.1 time: 0.023309 Oct 23 20:14:42.536024 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 491/1014] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 23 20:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509594046 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:14:45.831261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-220fe8e8-15fb-4b86-997e-74608b1dc15c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: .version_select at 0x7f64f018a0d0>, body: {"keypair": {"name": "tempest-keypair-1916960033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxrBa8VB6sfBfFs+A860u19rzQCJ5T44Ub0VCxxBtDIo7AyBrEwpiiSjsoi+Y32LsD0/s7vCgKpRv1X0NjyPp3TQTQkyonAf/FHxcrFN4P2kdy/c4asTGnklacB9Qvsgw=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:45.848148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-220fe8e8-15fb-4b86-997e-74608b1dc15c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:14:45.855491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-220fe8e8-15fb-4b86-997e-74608b1dc15c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:14:45.883227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-220fe8e8-15fb-4b86-997e-74608b1dc15c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055734 Oct 23 20:14:45.884180 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 524/1015] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:14:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:45.987228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:45.990227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:45.992537 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:46.001086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.001837 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.002490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.003368 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.003989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.004573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.009485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:46.039708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d15554c9-c34a-4e24-9dd1-c0af0354a7aa tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056960 Oct 23 20:14:46.040597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 492/1016] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:14:45 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:14:46.186839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:46.189084 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:46.196419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.197055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.197584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.198403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.198950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.199730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.378648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2289ce73-34ec-4670-946d-436f13e79e73 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196567 Oct 23 20:14:46.379330 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 525/1017] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:14:46 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:14:46.441336 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:46.441829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:46.447747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.448228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.448657 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.449598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.450063 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.450503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.475973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:14:46.563790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f0ac0db6-0847-49c6-a1fc-455f74887a95 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 204 len: 0 microversion: 2.1 time: 0.126030 Oct 23 20:14:46.565732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 493/1018] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:14:46 2022] DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:14:46.575326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:46.575932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:46.582137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.582869 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.583360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.584052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:46.584507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:46.584926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:46.800088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:46.808266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b74f7a15-39be-4273-8081-71f4687b7173 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1673 microversion: 2.1 time: 0.238230 Oct 23 20:14:46.808823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 526/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:46 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:14:47.510711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1769076618", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d505897-a26b-4ba1-98e0-a78acd4b7259"}], "security_groups": [{"name": "tempest-securitygroup--936092764"}], "key_name": "tempest-keypair-1916960033", "user_data": "}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:47.632648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] validate_networks() for [('5d505897-a26b-4ba1-98e0-a78acd4b7259', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:14:47.833878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:47.834721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:47.842345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:47.842831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:47.843270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:47.843957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:47.844406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:47.844995 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:48.172973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:14:48.176317 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:14:48.177054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:14:48.177668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:14:48.178320 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:14:48.187932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:48.200850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d8c87502-952f-4155-83db-9d2206faec3c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1673 microversion: 2.1 time: 0.371053 Oct 23 20:14:48.202285 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 527/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:47 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1673 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:48.206388 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:48.207192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:48.207787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:48.208755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:48.209578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:48.210149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:48.234038 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:14:48.239649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:14:48.253292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:14:48.255692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:14:48.309192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3ce5e179-1cc1-4208-ac6d-f49d41ab6df8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.803019 Oct 23 20:14:48.317153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 494/1021] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:14:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:14:48.321970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-49ed9420-6577-40b0-a2a2-c00f5fba4499 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:48.322611 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-49ed9420-6577-40b0-a2a2-c00f5fba4499 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:48.394086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-49ed9420-6577-40b0-a2a2-c00f5fba4499 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:48.402290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-49ed9420-6577-40b0-a2a2-c00f5fba4499 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1242 microversion: 2.1 time: 0.084091 Oct 23 20:14:48.403756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 528/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:48 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:49.234227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:49.237704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:49.256019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:49.256652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:49.257098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:49.257832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:49.258322 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:49.258760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:49.417877 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:49.427315 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:49.427932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:49.432003 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fafff006-ffae-49c2-a66d-3a496372b711 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1606 microversion: 2.1 time: 0.210505 Oct 23 20:14:49.433143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 495/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:49 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1606 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:49.435530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:49.440803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:49.442639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:49.443443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:49.447043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:49.447622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:49.621461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:49.636971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7fa49aa3-7360-4b58-8384-9d276f354cd2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1294 microversion: 2.1 time: 0.213386 Oct 23 20:14:49.638117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 529/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:49 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1294 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:49.790892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d97f22e-44b3-48cf-b17e-8ace7a5d67dc", "name": "network-vif-deleted", "tag": "c63cc4c4-cffa-4b0e-b0ee-c912548afbac"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:49.801748 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:49.802528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:49.803127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:49.815251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] Creating event network-vif-deleted:c63cc4c4-cffa-4b0e-b0ee-c912548afbac for instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc on hv-cinder-86243 Oct 23 20:14:49.822050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-b12176c7-cd4f-4106-83ea-dc4e201407f1 req-0b42546c-8017-4c8b-b3b5-d54ce90ebe38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034832 Oct 23 20:14:49.823804 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 496/1025] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:50.460687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:50.461945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:50.470786 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:50.471595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:50.473642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:50.474641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:50.476141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:50.476834 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:50.518388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:50.519227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:50.519882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:50.520542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lazy-loading 'fault' on Instance uuid 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:14:50.578736 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aca00ea597140c5be97a6a4fa33f9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb0d7d16214912a585ca96cf6b2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:50.596637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b4b16f7f-fbd1-467b-a798-21b9115df7f5 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 200 len: 1327 microversion: 2.1 time: 0.139322 Oct 23 20:14:50.600059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 530/1026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:50 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:50.667723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:50.668483 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:50.680516 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:50.681319 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:50.682071 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:50.682882 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:50.683559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:50.684192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:50.974954 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:50.986959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5387f026-62e9-4f3d-9650-18a5f990ddcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.329524 Oct 23 20:14:51.003458 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 497/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:50 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:51.622165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:51.622843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:51.629879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:51.630601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:51.631087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:51.631880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:51.632408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:51.632923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:51.648609 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc HTTP/1.1 Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:14:51.650318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:51.651802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '6d97f22e-44b3-48cf-b17e-8ace7a5d67dc'} Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:51.657060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:51.658693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:51.660109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:51.660109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c27102f7-cc64-464f-b3db-0904fdd9687c tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 404 len: 111 microversion: 2.1 time: 0.033657 Oct 23 20:14:51.660109 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 531/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:51 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:51.665564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d654f8e3-6899-4b8d-af7f-38771c0018ad tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '.version_select at 0x7f64f031fdc0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:51.690046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d654f8e3-6899-4b8d-af7f-38771c0018ad tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222833440" status: 202 len: 0 microversion: 2.1 time: 0.028309 Oct 23 20:14:51.694226 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 498/1029] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 20:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222833440 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:14:51.937201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed421b0-ddb9-4cbf-bee9-d88167e9fdf3", "tag": "85da16f6-b75c-46b1-9b91-e7d06025b9f9"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:51.946837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:51.947577 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:51.948279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:51.960501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] Creating event network-changed:85da16f6-b75c-46b1-9b91-e7d06025b9f9 for instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 on hv-cinder-86243 Oct 23 20:14:51.968990 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-2d8b2218-8671-43d2-a692-4a12ff3806ab req-a855af52-27e8-4010-9703-07e7c8229ee7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035197 Oct 23 20:14:51.969589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 532/1030] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:52.013496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:52.013496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:52.020912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:52.021763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:52.022414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:52.024096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:52.024664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:52.025192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:52.240974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:52.249812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-88d719a6-f052-4e59-8756-58100c4186de tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.240982 Oct 23 20:14:52.250592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 499/1031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:52 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:14:53.274038 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:53.274732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:53.276625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:53.282628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:53.283103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:53.283528 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:53.284205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:53.284655 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:53.285068 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:53.418716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:53.426863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-477a5023-e7f5-46b8-ac35-10f7db660ef0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.157618 Oct 23 20:14:53.427418 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 533/1032] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:53 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:54.449204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:54.450100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:54.456554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.457029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.457456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.458132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.458607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.459024 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.674405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:54.684869 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-ab9a8ef1-22be-4a5e-9b0a-fecbf5b86901 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.239541 Oct 23 20:14:54.685476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 500/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:54 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:54.840672 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:54.843142 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:54.849624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.850440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.851032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.851915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.852650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.853232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.867327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc HTTP/1.1 Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:14:54.869212 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.870865 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '6d97f22e-44b3-48cf-b17e-8ace7a5d67dc'} Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:54.871750 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.873289 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.875509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:54.876507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e63e82fd-01b7-4403-b022-7ffadfc8494a tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 404 len: 111 microversion: 2.1 time: 0.039731 Oct 23 20:14:54.877226 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 534/1034] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:14:54 2022] DELETE /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:54.885685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:54.886553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:54.896308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.896988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.901589 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.902362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:54.902844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:54.903283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:54.920754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc HTTP/1.1 Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:14:54.922709 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.924203 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '6d97f22e-44b3-48cf-b17e-8ace7a5d67dc'} Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:54.925093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. Oct 23 20:14:54.926601 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:54.927925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 6d97f22e-44b3-48cf-b17e-8ace7a5d67dc could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:54.927925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4db4e554-2d93-4cb8-83b0-106f9058c152 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc" status: 404 len: 111 microversion: 2.1 time: 0.046247 Oct 23 20:14:54.931493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 501/1035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:54 2022] GET /compute/v2.1/servers/6d97f22e-44b3-48cf-b17e-8ace7a5d67dc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:55.707861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:55.708465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:55.714405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:55.714888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:55.715317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:55.715997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:55.716449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:55.717374 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:55.846612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:55.854599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7395e1c4-d824-4f5e-98e0-e0c57cde4553 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.150619 Oct 23 20:14:55.855148 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 535/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:55 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:56.099666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:56.100204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:56.106554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.107058 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.107480 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.108472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.109282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.110039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.126823 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 HTTP/1.1 Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:14:56.128366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.129892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '80f3d6cd-5a81-425b-a929-808f46010e76'} Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:56.130851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.132371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.133986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:56.133986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b143e9d5-180d-4e96-8ef5-96770b72f0c0 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 404 len: 111 microversion: 2.1 time: 0.033938 Oct 23 20:14:56.133986 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 502/1037] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:14:56 2022] DELETE /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:56.138446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:56.139566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] [instance: 80f3d6cd-5a81-425b-a929-808f46010e76] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:56.145451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.145931 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.146393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.147077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.147531 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.147950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.161551 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] HTTP exception thrown: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Request method failure captured: Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 HTTP/1.1 Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6CcQso3HILYyxCDZ4waeECoQOcxY6ZFYmfGUJ2etHq6ZJhmWmi0lJWy2DTNFuuu4e8I4mVt1KQA7-KlaKD84uEFn-AxX_U9jmOuZXr7iwFxPDUu2NxcGUFcN_Opl4yxh_2Nnu0VAY-DnldLMxHUsWP4zodF38SqS-y9Ui9HIxU7Kc Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:14:56.163080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ebb0d7d16214912a585ca96cf6b2c6a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ebb0d7d16214912a585ca96cf6b2c6a"}]}] Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 5ebb0d7d16214912a585ca96cf6b2c6a Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-698208453 Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7aca00ea597140c5be97a6a4fa33f9c7 Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeTestJSON-698208453-project Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.164584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '80f3d6cd-5a81-425b-a929-808f46010e76'} Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:14:56.165456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. Oct 23 20:14:56.166703 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:14:56.167740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] Returning 404 to user: Instance 80f3d6cd-5a81-425b-a929-808f46010e76 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:14:56.167740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3c2ded3a-5a6d-4ce3-9eb5-254e42c948e4 tempest-AttachVolumeTestJSON-698208453 tempest-AttachVolumeTestJSON-698208453-project] 10.222.0.13 "GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76" status: 404 len: 111 microversion: 2.1 time: 0.030074 Oct 23 20:14:56.167740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 536/1038] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:56 2022] GET /compute/v2.1/servers/80f3d6cd-5a81-425b-a929-808f46010e76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:14:56.878789 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:56.879314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:56.885808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.886228 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.886684 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.887385 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.887836 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.888455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.938436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed421b0-ddb9-4cbf-bee9-d88167e9fdf3", "name": "network-vif-plugged", "status": "completed", "tag": "85da16f6-b75c-46b1-9b91-e7d06025b9f9"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:14:56.953720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:56.965774 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:56.966727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:56.980591 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] Creating event network-vif-plugged:85da16f6-b75c-46b1-9b91-e7d06025b9f9 for instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 on hv-cinder-86243 Oct 23 20:14:56.988073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-1db62064-0ee4-4771-8d00-d42e10907c48 req-eb62b144-ecde-4d5a-a82d-c8917fccccf3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054776 Oct 23 20:14:56.988825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 537/1039] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:14:57.083649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:57.093484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-df36dddb-7b95-43ff-9d77-7d8798ad98af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.218568 Oct 23 20:14:57.108037 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 503/1040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:56 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:58.117689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:58.118425 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:58.125788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:58.127058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:58.127993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:58.129081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:58.129916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:58.130717 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:58.278499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:58.292907 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a3efd7a0-a319-401d-84fd-8603677f3975 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1367 microversion: 2.1 time: 0.179816 Oct 23 20:14:58.293772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 538/1041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:58 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:14:59.316430 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:59.317085 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:59.319535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:59.320223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:59.327008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:59.327527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:59.328349 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:59.329664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:59.330468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:59.331264 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:59.491311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:14:59.500616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c4669dde-3ce1-454a-a92f-20997c151883 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1558 microversion: 2.1 time: 0.188201 Oct 23 20:14:59.501418 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 504/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:14:59 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:14:59.524403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:14:59.524976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:14:59.528001 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:59.532564 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:59.533083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:59.533512 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:59.534210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:14:59.534697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:14:59.535116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:14:59.641989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-90c7435f-1a02-4266-bde9-92e6abce4635 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121549 Oct 23 20:14:59.642629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 539/1043] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:14:59 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:15:00.584852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a06b6f8f-79d9-4115-9a34-dca8e7510750 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Action: 'create', calling method: .version_select at 0x7f64f0247ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632567569", "metadata": {"Type": "work"}}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a06b6f8f-79d9-4115-9a34-dca8e7510750 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 122 Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:15:00.610696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632567569", "metadata": {"Type": "work"}}} Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: Oct 23 20:15:00.612354 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1632567569', 'metadata': {'Type': 'work'}}}} Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise error Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi '#$%' Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.613305 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 20:15:00.614912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 20:15:00.616274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 20:15:00.616274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.616274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a06b6f8f-79d9-4115-9a34-dca8e7510750 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.616274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a06b6f8f-79d9-4115-9a34-dca8e7510750 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142600 Oct 23 20:15:00.616274 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 505/1044] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 20:15:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:00.623403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f4f5a24d-401c-4ddb-978f-ef6c603b245d tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Action: 'create', calling method: .version_select at 0x7f64f0268820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1362527955", "metadata": {"Type": "work"}}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f4f5a24d-401c-4ddb-978f-ef6c603b245d tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 120 Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:00.628372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1362527955", "metadata": {"Type": "work"}}} Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:15:00.630083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1362527955', 'metadata': {'Type': 'work'}}}} Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise error Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi '0' Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.631120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 20:15:00.632705 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 20:15:00.633856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 20:15:00.633856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.633856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f4f5a24d-401c-4ddb-978f-ef6c603b245d tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.633856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f4f5a24d-401c-4ddb-978f-ef6c603b245d tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012153 Oct 23 20:15:00.633856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 540/1045] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 20:15:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:00.642531 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8747f125-9d52-40bd-823e-907dec7704d7 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Action: 'create', calling method: .version_select at 0x7f64f031fc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1851581242", "metadata": {"Type": "work"}}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8747f125-9d52-40bd-823e-907dec7704d7 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 119 Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:15:00.647265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1851581242", "metadata": {"Type": "work"}}} Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: Oct 23 20:15:00.648871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1851581242', 'metadata': {'Type': 'work'}}}} Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise error Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi '' Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.649714 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 20:15:00.651178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 20:15:00.652270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 20:15:00.652270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.652270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8747f125-9d52-40bd-823e-907dec7704d7 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.652270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8747f125-9d52-40bd-823e-907dec7704d7 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010452 Oct 23 20:15:00.652270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 506/1046] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 23 20:15:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:00.658508 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7a1b833b-333a-4527-93f5-5cfb1473bb12 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Calling method '.version_select at 0x7f64f05b3310>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:00.687502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-7a1b833b-333a-4527-93f5-5cfb1473bb12 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] HTTP exception thrown: Volume tempest-invalid-1296801039 could not be found. Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7a1b833b-333a-4527-93f5-5cfb1473bb12 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1296801039 HTTP/1.1 Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:00.689504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Volume tempest-invalid-1296801039 could not be found. Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'tempest-invalid-1296801039'} Oct 23 20:15:00.691086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1296801039 could not be found. (HTTP 404) (Request-ID: req-a4eed7c9-f3ef-40a6-9555-9238ef1ac291) Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.691987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:15:00.693362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1296801039 could not be found. Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:00.695480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1296801039 could not be found. Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1296801039 could not be found. Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7a1b833b-333a-4527-93f5-5cfb1473bb12 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 404 to user: Volume tempest-invalid-1296801039 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7a1b833b-333a-4527-93f5-5cfb1473bb12 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1296801039" status: 404 len: 99 microversion: 2.1 time: 0.036808 Oct 23 20:15:00.696849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 541/1047] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 20:15:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1296801039 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 20:15:00.703648 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-54a6b275-0dbc-476d-b72f-478a589cb41c tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004571 Oct 23 20:15:00.704146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 507/1048] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 23 20:15:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 20:15:00.712362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-eaa4fcab-efac-4f9f-a4d8-29eccea6cb22 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003695 Oct 23 20:15:00.712852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 542/1049] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 23 20:15:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 20:15:00.721561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0b32931-efc6-475f-b47e-351d1164a954 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Calling method '.version_select at 0x7f64f013c040>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:00.748909 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-e0b32931-efc6-475f-b47e-351d1164a954 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] HTTP exception thrown: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0b32931-efc6-475f-b47e-351d1164a954 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/os-volumes/b875d013-261c-4e9c-a568-41bb7e377a45 HTTP/1.1 Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:15:00.750895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'b875d013-261c-4e9c-a568-41bb7e377a45'} Oct 23 20:15:00.752433 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. (HTTP 404) (Request-ID: req-a3d905a6-167c-4795-8c39-70fac08ddb60) Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.753288 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 20:15:00.754680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 20:15:00.755851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e0b32931-efc6-475f-b47e-351d1164a954 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 404 to user: Volume b875d013-261c-4e9c-a568-41bb7e377a45 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e0b32931-efc6-475f-b47e-351d1164a954 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/b875d013-261c-4e9c-a568-41bb7e377a45" status: 404 len: 109 microversion: 2.1 time: 0.034419 Oct 23 20:15:00.757507 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 508/1050] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:15:00 2022] DELETE /compute/v2.1/os-volumes/b875d013-261c-4e9c-a568-41bb7e377a45 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:15:00.761749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-096870d0-f472-4402-9552-6b94585be040 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Calling method '.version_select at 0x7f64f17e95e0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:00.792925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-096870d0-f472-4402-9552-6b94585be040 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] HTTP exception thrown: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-096870d0-f472-4402-9552-6b94585be040 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Request method failure captured: Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/os-volumes/d901b93a-de10-440c-8e80-3098a9d4b0ac HTTP/1.1 Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaDEXLiRlTkvVlENgMFNyzS_aPg8qqJGMnNTXQBkrvyYcXuKekUWhCpDv06C2H471qAQQAZ9GqEKZ34pbMi7NuYNmpHN9v2JJVJ65vJXrtq9PcNbgI1OP_6WLEuwUjor--IIKcdjxVzFmhW6ffKLFjjgx_VIWDHPcsZAnR68AGSOFrw Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:00.794924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0289c86cb5b947c0b0fb326895d6f77e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0289c86cb5b947c0b0fb326895d6f77e"}]}] Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 0289c86cb5b947c0b0fb326895d6f77e Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesNegativeTest-1018432375 Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: dbababb082d94ab485a2b343d00d913b Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesNegativeTest-1018432375-project Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'd901b93a-de10-440c-8e80-3098a9d4b0ac'} Oct 23 20:15:00.796415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. (HTTP 404) (Request-ID: req-46853036-5e99-483a-aa89-06313b6b5d77) Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.797405 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 20:15:00.798851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 20:15:00.800100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-096870d0-f472-4402-9552-6b94585be040 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] Returning 404 to user: Volume d901b93a-de10-440c-8e80-3098a9d4b0ac could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-096870d0-f472-4402-9552-6b94585be040 tempest-VolumesNegativeTest-1018432375 tempest-VolumesNegativeTest-1018432375-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d901b93a-de10-440c-8e80-3098a9d4b0ac" status: 404 len: 109 microversion: 2.1 time: 0.038342 Oct 23 20:15:00.801547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 543/1051] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:15:00 2022] GET /compute/v2.1/os-volumes/d901b93a-de10-440c-8e80-3098a9d4b0ac => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 20:15:00.831720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed421b0-ddb9-4cbf-bee9-d88167e9fdf3", "tag": "85da16f6-b75c-46b1-9b91-e7d06025b9f9"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:15:00.844404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:00.845199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:00.845805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:00.860086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] Creating event network-changed:85da16f6-b75c-46b1-9b91-e7d06025b9f9 for instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 on hv-cinder-86243 Oct 23 20:15:00.865255 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-4cc6dfbe-87a3-408a-a9ac-c2b99e26b3ae req-8ba9a83d-6a20-42ca-8f5d-9eca7515f152 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038849 Oct 23 20:15:00.866438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 509/1052] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:15:30.349243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=13 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:30.350131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:30.354304 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:30.356532 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:30.363656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.364146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.364587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.365283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.365740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.366174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.395885 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0bc0b3dc-da55-456c-b40a-c412ac0e1a02 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048545 Oct 23 20:15:30.396446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 544/1053] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 23 20:15:30 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:15:30.457940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:30.458704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:30.463743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:30.464358 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:30.473360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.474300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.475103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.475853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.476311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.476735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.506132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:15:30.582386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2fe6228f-7213-4c88-8abf-5652fc5e16ac tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 204 len: 0 microversion: 2.20 time: 0.125866 Oct 23 20:15:30.583290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 510/1054] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 20:15:30 2022] DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 20:15:30.591445 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:30.592308 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:30.598421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.598901 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.599323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.600007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:30.600453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:30.600971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:30.898228 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:30.906225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:30.907667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:30.908808 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-03fadf32-43df-4e78-ad9b-729ac330dd21 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.321310 Oct 23 20:15:30.909357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 545/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:30 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:15:31.935012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:31.935722 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:31.942822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:31.943311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:31.943747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:31.944445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:31.944905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:31.945412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:32.159022 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:32.167293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:32.168717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:32.169863 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-35075be0-1f50-4b8e-b981-bd9779556113 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1725 microversion: 2.20 time: 0.239272 Oct 23 20:15:32.170445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 511/1056] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:31 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:15:33.195256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:33.195890 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:33.202807 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:33.203290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:33.203725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:33.204422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:33.204880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:33.205302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:33.277505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:33.286014 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:33.287468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cef68ee160348dea427e6c46b775e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4023fb7431ad496fa044b19190f014d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:15:33.288603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e1061890-4b21-4057-9b25-d0c5e37ac161 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 200 len: 1657 microversion: 2.20 time: 0.097366 Oct 23 20:15:33.289150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 546/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:33 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 1657 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 20:15:33.371929 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c8bb-0374-4379-a0a7-c1531ae5b10e", "name": "network-vif-deleted", "tag": "c97132ca-3b21-4ca1-846d-806a393225ba"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:15:33.382678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:33.383163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:33.383592 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:33.400607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] Creating event network-vif-deleted:c97132ca-3b21-4ca1-846d-806a393225ba for instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e on hv-cinder-86243 Oct 23 20:15:33.419987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-bec299a3-c421-4caf-8a44-a614bbb11fc5 req-49560bda-18a0-45f6-8ec9-4694c77bb72f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051494 Oct 23 20:15:33.421214 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 512/1058] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:15:34.312832 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:34.313444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:34.320107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:34.320595 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:34.321034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:34.321731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:34.322184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:34.322632 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:34.336787 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e HTTP/1.1 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:34.338364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:34.340056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '4c84c8bb-0374-4379-a0a7-c1531ae5b10e'} Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:34.340940 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:34.342616 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:34.344390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:34.344390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c577871c-0827-4ffa-b164-dd8cc7ac3dad tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 404 len: 111 microversion: 2.20 time: 0.030788 Oct 23 20:15:34.344390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 547/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:34 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:34.349137 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1d39bf75-6ab9-4106-a6a8-f865694d42dd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '.version_select at 0x7f64f05d68b0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:34.368918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1d39bf75-6ab9-4106-a6a8-f865694d42dd tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988014208" status: 204 len: 0 microversion: 2.20 time: 0.023844 Oct 23 20:15:34.369538 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 513/1060] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 23 20:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988014208 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 20:15:36.111486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:36.112481 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:36.118762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:36.119245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:36.119681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:36.120367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:36.120839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:36.121254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:36.134936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e HTTP/1.1 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:36.136459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.138062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '4c84c8bb-0374-4379-a0a7-c1531ae5b10e'} Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:36.138982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.140393 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.141818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:36.141818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f06574b0-ca05-49e0-8d50-1aa95a013fd9 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 404 len: 111 microversion: 2.20 time: 0.030177 Oct 23 20:15:36.141818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 548/1061] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 20:15:36 2022] DELETE /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 20:15:36.149962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:36.150729 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4c84c8bb-0374-4379-a0a7-c1531ae5b10e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:36.157701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:36.158186 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:36.158647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:36.159337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:36.159798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:36.160237 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:36.173259 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e HTTP/1.1 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:15:36.175403 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.177128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '4c84c8bb-0374-4379-a0a7-c1531ae5b10e'} Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:36.178089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. Oct 23 20:15:36.179743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:36.181129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4c84c8bb-0374-4379-a0a7-c1531ae5b10e could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:36.181129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c9bcfabf-a998-4430-a857-c78ab6ad651b tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e" status: 404 len: 111 microversion: 2.20 time: 0.030778 Oct 23 20:15:36.181129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 514/1062] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:36 2022] GET /compute/v2.1/servers/4c84c8bb-0374-4379-a0a7-c1531ae5b10e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:37.316878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:37.317362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:37.323718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:37.324201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:37.324634 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:37.325584 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:37.326040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:37.326501 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:37.339547 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de HTTP/1.1 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:15:37.341071 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.342734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '4abcffff-127a-4a75-84a5-19e12536b4de'} Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:37.343535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.344891 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.346881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:37.346881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5f0327e1-eaac-40d3-8f27-c4afad5f664a tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 404 len: 111 microversion: 2.20 time: 0.029431 Oct 23 20:15:37.346881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 549/1063] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 23 20:15:37 2022] DELETE /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:15:37.351256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:15:37.351861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] [instance: 4abcffff-127a-4a75-84a5-19e12536b4de] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:15:37.358145 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:37.358654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:37.359083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:37.359760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:15:37.360206 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:15:37.360623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:15:37.374110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] HTTP exception thrown: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Request method failure captured: Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de HTTP/1.1 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVZ6F3eZW8E8393pItod12uiqhsIHg8HWVnInkZCcdvTkSV2MuS-_T2HiEjPDu4hTB-bJryqmPoIksqfrXAwxIF_Im_CW1t-q-86spsNwIRr7-OhiRvdzElP_quUeKPE7phJFm4n6iFSIXJ1UoBwgtisl9TsYsqYINLEQD7B5P1U4t54 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:15:37.375636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4023fb7431ad496fa044b19190f014d8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4023fb7431ad496fa044b19190f014d8"}]}] Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 4023fb7431ad496fa044b19190f014d8 Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1841363174 Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 7cef68ee160348dea427e6c46b775e2d Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1841363174-project Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.377276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '4abcffff-127a-4a75-84a5-19e12536b4de'} Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:15:37.378088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. Oct 23 20:15:37.379304 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:15:37.380511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] Returning 404 to user: Instance 4abcffff-127a-4a75-84a5-19e12536b4de could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:15:37.380511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-755be4c4-a3c6-4d6c-97d1-c0c8dd48ab55 tempest-AttachVolumeShelveTestJSON-1841363174 tempest-AttachVolumeShelveTestJSON-1841363174-project] 10.222.0.13 "GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de" status: 404 len: 111 microversion: 2.20 time: 0.029543 Oct 23 20:15:37.380511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 515/1064] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 23 20:15:37 2022] GET /compute/v2.1/servers/4abcffff-127a-4a75-84a5-19e12536b4de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:16:02.389667 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1677202029", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "networks": [{"uuid": "f06d0ad6-fb4a-4030-ac73-03fa0d42c27b"}]}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:02.399231 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 20:16:02.399454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Sun Oct 23 20:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 23 20:16:02.402054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=12 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:02.402778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=24 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:02.450210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] validate_networks() for [('f06d0ad6-fb4a-4030-ac73-03fa0d42c27b', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:16:02.825277 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:16:02.825993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:16:02.826603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:16:02.827011 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:16:02.827423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:16:02.837105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:02.837589 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:02.838016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:02.838763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:02.839215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:02.839631 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:02.858069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Getting quotas for project 0df26e575de34eda9d416de65ec13036. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:16:02.862102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Getting quotas for user 52c576b9f49b4900ac5ba707aba78c27 and project 0df26e575de34eda9d416de65ec13036. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:16:02.874163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:16:02.876566 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:16:02.923933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ed3733f6-7019-4066-9170-407551896c96 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538186 Oct 23 20:16:02.924605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 550/1065] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:16:02.935920 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e08affc7-d216-49b7-9526-463caae06d39 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:02.937095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e08affc7-d216-49b7-9526-463caae06d39 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:02.940612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:02.941629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:03.016697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e08affc7-d216-49b7-9526-463caae06d39 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:03.025307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e08affc7-d216-49b7-9526-463caae06d39 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1219 microversion: 2.1 time: 0.093014 Oct 23 20:16:03.026314 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 516/1066] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:02 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:04.049318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:04.050090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:04.057215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:04.057555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:04.058096 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:04.059211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:04.059628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:04.060056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:04.169419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:04.178105 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-98f47cac-3c47-4100-8751-263011404967 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1277 microversion: 2.1 time: 0.133189 Oct 23 20:16:04.178732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 551/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:04 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:05.202143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:05.202936 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:05.210227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:05.210812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:05.211975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:05.212773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:05.213296 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:05.214151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:05.431900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:05.439938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e9e21ce9-a26c-407b-a08a-81104733d8e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.242517 Oct 23 20:16:05.440633 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 517/1068] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:05 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:05.576328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d88de2-7c8e-4437-9246-01edb001924b", "tag": "1ed93978-2e8e-4a55-b148-38b74cd6213d"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:05.588259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:05.588946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:05.590293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:05.605696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] Creating event network-changed:1ed93978-2e8e-4a55-b148-38b74cd6213d for instance 88d88de2-7c8e-4437-9246-01edb001924b on hv-cinder-86243 Oct 23 20:16:05.610746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-1dd5890b-7577-40fd-89e6-db272e0cf063 req-42cca7d1-509a-4a28-8dc7-961185cd2dce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040887 Oct 23 20:16:05.611583 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 552/1069] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:16:06.462583 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:06.463293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:06.469749 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:06.470456 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:06.470896 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:06.471593 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:06.472050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:06.472475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:06.623574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:06.631205 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3a126cda-654a-4976-a50a-5f09a1077d26 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.172495 Oct 23 20:16:06.631786 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 518/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:06 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:07.654982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:07.655689 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:07.661733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:07.662219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:07.662692 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:07.663382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:07.663842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:07.664264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:07.799297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:07.807711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-91c1d9ef-3431-4ced-b508-c97d0ded99d0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.157341 Oct 23 20:16:07.808263 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 553/1071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:07 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:08.831326 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:08.831925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:08.838850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:08.839337 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:08.839771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:08.840464 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:08.840918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:08.841345 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:08.973895 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:08.981573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0a43af20-7684-49c7-96a1-5bd801dbf78d tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.154159 Oct 23 20:16:08.982138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 519/1072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:08 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:10.003353 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:10.003967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:10.010362 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:10.010847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:10.011279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:10.011966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:10.012416 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:10.012837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:10.148828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:10.156434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4ac95e40-c9fa-4bde-8f67-bdea90156183 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.156956 Oct 23 20:16:10.156998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 554/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:09 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:11.180208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:11.180820 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:11.187835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:11.188353 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:11.188785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:11.189484 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:11.189934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:11.190382 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:11.324429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:11.332547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bd665e36-1b49-4f3e-bb3e-eea444a8e0b0 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.157117 Oct 23 20:16:11.333312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 520/1074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:11 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:12.355715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:12.356326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:12.362472 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:12.362950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:12.363381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:12.364052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:12.364504 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:12.364922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:12.489452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:12.497716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-541bb8e9-1f47-4c68-869a-0a46137549dd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.145943 Oct 23 20:16:12.498314 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 555/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:12 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:13.208002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d88de2-7c8e-4437-9246-01edb001924b", "name": "network-vif-plugged", "status": "completed", "tag": "1ed93978-2e8e-4a55-b148-38b74cd6213d"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:13.214115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:13.220759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:13.221420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:13.221853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:13.232764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] Creating event network-vif-plugged:1ed93978-2e8e-4a55-b148-38b74cd6213d for instance 88d88de2-7c8e-4437-9246-01edb001924b on hv-cinder-86243 Oct 23 20:16:13.237673 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-1d88d48b-9ff9-4c3d-80e1-ad64c5566d9d req-2fe62fe1-bd35-45fc-a5aa-dcbbab0be004 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Oct 23 20:16:13.238420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 521/1076] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:13.528958 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:13.529507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:13.531452 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:13.532287 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:13.538266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:13.538765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:13.539204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:13.539888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:13.540341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:13.540763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:13.674630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:13.682735 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-84c2484c-28f8-4aa6-8a61-27e12aed819a tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.157754 Oct 23 20:16:13.683299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 556/1077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:13 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:14.706976 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:14.707692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:14.715707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:14.716191 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:14.716810 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:14.717602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:14.718135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:14.718587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:14.856054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:14.863657 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fa9f4037-8355-4d17-a024-4e2c28002494 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1319 microversion: 2.1 time: 0.161666 Oct 23 20:16:14.864231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 522/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:14 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:16:15.887033 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:15.887646 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:15.893985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:15.894502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:15.894941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:15.895624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:15.896078 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:15.896500 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:16.024326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:16.032047 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-78759ea4-d296-4211-88f7-066b9a029c00 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1507 microversion: 2.1 time: 0.149696 Oct 23 20:16:16.032605 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 557/1079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:15 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:30.685338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:30.685894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:30.688380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=16 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:30.689136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=32 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:30.695209 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.695691 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.696663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.697351 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.697807 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.698229 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.721423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-464c7f58-24aa-46c2-af49-52c6b5a10700 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/ips" status: 200 len: 151 microversion: 2.1 time: 0.040020 Oct 23 20:16:30.721983 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 523/1080] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:16:30 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:16:30.733467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157fb728-c596-449d-b934-0b989c8bc5fb"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:30.735837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:30.738219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:30.739085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=40 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:30.744992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.745470 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.745910 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.746600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.747052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.747468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.825359 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: POST /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/os-volume_attachments HTTP/1.1 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 74 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:16:30.827391 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {"volumeAttachment": {"volumeId": "157fb728-c596-449d-b934-0b989c8bc5fb"}} Oct 23 20:16:30.829056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'server_id': 'aed421b0-ddb9-4cbf-bee9-d88167e9fdf3', 'body': {'volumeAttachment': {'volumeId': '157fb728-c596-449d-b934-0b989c8bc5fb'}}} Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:30.830045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:30.831387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 400 to user: Invalid volume: volume 157fb728-c596-449d-b934-0b989c8bc5fb is already attached to instances: cbdda865-b8ca-4233-b550-d4c6a3127e61 {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2368d0a8-3fa3-41f5-a269-860e61b83868 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099303 Oct 23 20:16:30.832636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 558/1081] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:16:30 2022] POST /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:16:30.837349 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:30.837838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:30.843777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.844248 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.844671 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.845341 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.845787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.846202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.873056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:16:30.950176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c90cb881-5bba-4676-9346-0a75d04a1f4e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 204 len: 0 microversion: 2.1 time: 0.116304 Oct 23 20:16:30.951056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 524/1082] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:16:30 2022] DELETE /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:16:30.959417 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:30.960029 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:30.966850 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.967333 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.967764 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:30.968454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:30.968914 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:30.969336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:31.095666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:31.103742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-190043ee-f297-46d9-9797-146b2ecc43e3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1683 microversion: 2.1 time: 0.148258 Oct 23 20:16:31.104293 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 559/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:30 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:32.129777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:32.130515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:32.137573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:32.138056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:32.138533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:32.139227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:32.139686 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:32.140108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:32.330651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:32.338439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1251a332-7852-4558-8950-f244a34cd9ac tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1683 microversion: 2.1 time: 0.213863 Oct 23 20:16:32.339021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 525/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:32 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:33.361388 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:33.362225 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:33.370040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:33.370571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:33.370998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:33.371925 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:33.372515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:33.372947 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:33.473284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:33.497242 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ebd43948-ee57-437a-b64c-c8ef5a9ece95 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 200 len: 1616 microversion: 2.1 time: 0.140140 Oct 23 20:16:33.498510 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 560/1085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:33 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 1616 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:33.873042 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed421b0-ddb9-4cbf-bee9-d88167e9fdf3", "name": "network-vif-deleted", "tag": "85da16f6-b75c-46b1-9b91-e7d06025b9f9"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:33.889142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:33.889625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:33.890052 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:33.903210 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] Creating event network-vif-deleted:85da16f6-b75c-46b1-9b91-e7d06025b9f9 for instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 on hv-cinder-86243 Oct 23 20:16:33.909756 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-6349a529-e66f-4cfd-a8ca-c97ff7a56df3 req-34f582a3-13db-4319-846a-0381b39189cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228878 Oct 23 20:16:33.911192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 526/1086] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:34.521117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:34.521971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:34.530355 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:34.531169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:34.531677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:34.532484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:34.533286 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:34.534063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:34.549090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 HTTP/1.1 Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:16:34.551325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:16:34.552830 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'aed421b0-ddb9-4cbf-bee9-d88167e9fdf3'} Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:16:34.553738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:16:34.556087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:34.558279 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:16:34.562392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3d3afbe1-e271-4b97-9120-23b140b4fb77 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 404 len: 111 microversion: 2.1 time: 0.041518 Oct 23 20:16:34.563044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 561/1087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:34 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:16:34.573716 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f6a7c611-e020-4495-b2f5-e1f87d938511 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '.version_select at 0x7f64f049e3a0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:34.594942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f6a7c611-e020-4495-b2f5-e1f87d938511 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916960033" status: 202 len: 0 microversion: 2.1 time: 0.026592 Oct 23 20:16:34.595817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 527/1088] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 20:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916960033 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:16:35.305004 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:35.306511 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:35.313184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:35.313671 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:35.314107 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:35.314845 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:35.315302 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:35.315725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:35.399854 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lazy-loading 'services' on Instance uuid cbdda865-b8ca-4233-b550-d4c6a3127e61 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:16:35.472704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-24519a73-168a-44ef-9dd5-36f43d07f91f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments/157fb728-c596-449d-b934-0b989c8bc5fb" status: 202 len: 0 microversion: 2.1 time: 0.171661 Oct 23 20:16:35.473466 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 562/1089] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:16:35 2022] DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments/157fb728-c596-449d-b934-0b989c8bc5fb => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:16:35.483077 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:35.485439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:35.494006 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:35.494578 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:35.494912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:35.496566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:35.497031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:35.497455 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:35.531395 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2cbc3bee-f177-4ada-ad97-47e28668cd80 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052825 Oct 23 20:16:35.531965 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 528/1090] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:35 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:36.545210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:36.547596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:36.554120 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:36.554623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:36.555054 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:36.555729 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:36.556177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:36.556592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:36.585432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7c07ac15-f911-4eb2-ad98-1c3c9c79e643 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Oct 23 20:16:36.585968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 563/1091] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:36 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:37.598603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:37.600763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:37.607783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:37.608271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:37.608702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:37.609380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:37.609831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:37.610269 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:37.638253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-83919969-5a18-4a4a-989a-8ebf02c74298 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Oct 23 20:16:37.638818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 529/1092] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:37 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:38.649592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:38.651903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:38.658098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:38.658603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:38.659028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:38.659761 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:38.660210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:38.660641 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:38.699533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ef8db8cf-2e15-45b9-9801-a1270574df5a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053807 Oct 23 20:16:38.700453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 564/1093] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:38 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:39.712664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:39.714864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:39.721184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:39.721663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:39.722098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:39.722814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:39.723302 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:39.723726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:39.752556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4d395a4c-1c9b-46b3-8d7c-7bbd9d3d9685 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Oct 23 20:16:39.753102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 530/1094] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:39 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:40.766215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:40.768440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:40.774827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:40.775309 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:40.775741 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:40.776494 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:40.776949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:40.777371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:40.807902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e55adaf3-2b74-49f0-9c64-da1fd8a84626 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Oct 23 20:16:40.808463 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 565/1095] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:40 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:41.820412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:41.822644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:41.830438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.830925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.831360 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:41.832094 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.832554 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.832976 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:41.861841 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1ef70730-8132-4ef6-bc2c-e5ead980f4ed tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045407 Oct 23 20:16:41.862441 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 531/1096] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:16:41 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:16:41.924421 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:41.924969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:41.931852 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.932187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.932626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:41.933299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.933749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.934166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:41.959241 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:16:41.963964 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "716d9ecb-6f28-4b9f-a786-f069cd7c0632", "device": "/dev/sdb"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:41.966884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:41.972631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.973144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.973533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:41.974269 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:41.974685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:41.975105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:42.041336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-19ec3916-bd38-4b90-9470-24dffc4448e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 204 len: 0 microversion: 2.1 time: 0.120559 Oct 23 20:16:42.042117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 566/1097] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:16:41 2022] DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:16:42.050721 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:42.051430 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:42.057318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:42.057799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:42.058268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:42.058981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:42.059436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:42.059860 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:42.188021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:42.195795 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5ea8eba7-34ae-4c1e-a0cd-ad6704ed5d17 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1684 microversion: 2.1 time: 0.149285 Oct 23 20:16:42.196358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 567/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:42 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:16:43.227441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:43.228697 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:43.236429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:43.237579 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:43.238236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:43.239446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:43.239923 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:43.240548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:43.389139 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:43.397892 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-de6dc1e9-31aa-467f-9bbc-5c590b766b1e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1684 microversion: 2.1 time: 0.182264 Oct 23 20:16:43.398745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 568/1099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:43 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:43.415014 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6174a793-f0f1-4452-8ea7-e3cf5da4d8da tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "POST /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.454324 Oct 23 20:16:43.418444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 532/1100] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:16:41 2022] POST /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b/os-volume_attachments => generated 194 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:16:44.427141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:44.428439 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:44.439124 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:44.439715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:44.440446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:44.441950 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:44.442626 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:44.443888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:44.517861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:44.527586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4206a58a-56fd-4c8f-9464-284540b4c014 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 200 len: 1616 microversion: 2.1 time: 0.106214 Oct 23 20:16:44.528581 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 569/1101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:44 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 1616 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:44.705783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdda865-b8ca-4233-b550-d4c6a3127e61", "name": "network-vif-deleted", "tag": "347c96fd-ea12-48fc-8e67-96489156f197"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:44.716613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:44.717100 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:44.717614 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:44.734712 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] Creating event network-vif-deleted:347c96fd-ea12-48fc-8e67-96489156f197 for instance cbdda865-b8ca-4233-b550-d4c6a3127e61 on hv-cinder-86243 Oct 23 20:16:44.739814 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-f08a68b7-7c8c-44b5-8a00-2ed49fa4838c req-ff44ed54-ff7f-496d-9b7e-f27814e9b8e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038829 Oct 23 20:16:44.747120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 533/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:45.552876 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:45.553601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:45.560318 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:45.560803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:45.561372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:45.562082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:45.562560 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:45.562987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:45.579468 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 HTTP/1.1 Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:16:45.581437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:16:45.583224 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'cbdda865-b8ca-4233-b550-d4c6a3127e61'} Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:16:45.584188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:16:45.585775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:16:45.588797 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:16:45.589831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fb13a07d-e4b3-438e-8b6f-eac4c8948296 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 404 len: 111 microversion: 2.1 time: 0.042512 Oct 23 20:16:45.590600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 570/1103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:45 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:16:45.600370 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-157db70d-c101-4110-9c27-79340cec3c8f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '.version_select at 0x7f64f0722c10>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:45.629450 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-157db70d-c101-4110-9c27-79340cec3c8f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164896437" status: 202 len: 0 microversion: 2.1 time: 0.033811 Oct 23 20:16:45.646367 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 534/1104] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 20:16:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164896437 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:16:46.535897 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8f19da1f-b2bd-415a-b5eb-6a2cfc4c7f52 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: .version_select at 0x7f64f01cdb80>, body: {"keypair": {"name": "tempest-keypair-1484874508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9ZdzOABmI5wm5gUSr/5+n9oN39gwoQtM0SGjgIjy8n0TLrs3Y8IrM/HLMq4Ybtwdgib9Idlf5yzqS0NQCjMdAwObx+Vy1m3ZCYqjxbzRDbb5eiKKjB278VRb9VSyDP2A=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:46.551602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-8f19da1f-b2bd-415a-b5eb-6a2cfc4c7f52 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:16:46.555349 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-8f19da1f-b2bd-415a-b5eb-6a2cfc4c7f52 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:16:46.577021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8f19da1f-b2bd-415a-b5eb-6a2cfc4c7f52 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044922 Oct 23 20:16:46.577533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 571/1105] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:16:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:47.860282 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1410026397", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d505897-a26b-4ba1-98e0-a78acd4b7259"}], "security_groups": [{"name": "tempest-securitygroup--1703778330"}], "key_name": "tempest-keypair-1484874508", "user_data": "}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:47.964558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] validate_networks() for [('5d505897-a26b-4ba1-98e0-a78acd4b7259', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:16:48.328411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:16:48.328830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:16:48.329294 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:16:48.329694 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:16:48.330097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:16:48.339209 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:48.339681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:48.340130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:48.340848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:48.341308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:48.341796 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:48.358146 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:16:48.362108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:16:48.373173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:16:48.375620 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:16:48.424297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-39e2a133-eb59-416f-bbe7-dbc6c9f32aec tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568279 Oct 23 20:16:48.424950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 535/1106] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:16:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:16:48.436535 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-298a5eb9-2ded-4fc2-941d-3ce2320254dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:48.437137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-298a5eb9-2ded-4fc2-941d-3ce2320254dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:48.498443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-298a5eb9-2ded-4fc2-941d-3ce2320254dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:48.505854 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-298a5eb9-2ded-4fc2-941d-3ce2320254dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1242 microversion: 2.1 time: 0.073620 Oct 23 20:16:48.506443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 572/1107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:48 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:49.530579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:49.531193 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:49.537765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:49.538284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:49.538707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:49.539950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:49.540406 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:49.540828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:49.599603 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:49.607708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7f033097-ad14-4aea-aa4b-4b19d8174fe7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1294 microversion: 2.1 time: 0.081482 Oct 23 20:16:49.608273 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 536/1108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:49 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:50.630651 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:50.631832 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:50.638555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:50.639375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:50.639811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:50.640539 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:50.640949 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:50.641559 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:50.711888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:50.719884 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1868e62d-e6b2-4244-afdb-7a76480bbd0d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1300 microversion: 2.1 time: 0.093212 Oct 23 20:16:50.720478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 573/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:50 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:51.742404 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:51.743012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:51.749496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:51.749974 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:51.750445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:51.751138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:51.751588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:51.752005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:51.883227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:51.890938 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d2a02396-6ebf-487e-8073-d707440d156b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.152373 Oct 23 20:16:51.891499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 537/1110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:51 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:52.662998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c571552-4e80-4170-9cc6-aa8ccb5a180a", "tag": "52aa7e62-de00-4e05-aae6-56a7a696b6e7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:16:52.672769 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:52.673249 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:52.673680 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:52.684789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] Creating event network-changed:52aa7e62-de00-4e05-aae6-56a7a696b6e7 for instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a on hv-cinder-86243 Oct 23 20:16:52.689592 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-4b55a968-9a54-4fd9-94a5-70d96faf7b0c req-9a360f32-d9ca-42bd-a6e6-c896927d1fed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030362 Oct 23 20:16:52.690179 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 574/1111] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:16:52.912912 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:52.913524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:52.920644 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:52.921135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:52.921574 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:52.922284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:52.922751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:52.923174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:53.052286 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:53.060504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-25cdd24e-55e0-47a4-a1dd-d63dc1a70142 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.151506 Oct 23 20:16:53.061079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 538/1112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:52 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:54.083936 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:54.084666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:54.091307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:54.091784 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:54.092217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:54.092899 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:54.093354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:54.093778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:54.220924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:54.230408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f2124fc5-7350-40af-963a-b879e41b1bdb tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.151004 Oct 23 20:16:54.231059 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 575/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:54 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:55.253164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:55.253710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:55.260161 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:55.260660 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:55.261095 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:55.261790 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:55.262509 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:55.262681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:55.421136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:55.429105 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5773f4bf-ffa0-493e-a0aa-9a661fc6a08e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.179866 Oct 23 20:16:55.430439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 539/1114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:55 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:56.460730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:56.461337 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:56.467781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:56.468235 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:56.468660 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:56.469343 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:56.469793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:56.470216 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:56.474414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:56.614426 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:56.622687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-df6222c2-e94e-41de-b48c-747c8f435078 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.165725 Oct 23 20:16:56.623248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 576/1115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:56 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:57.644802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:57.645439 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:57.652481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:57.652959 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:57.653396 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:57.654079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:57.654567 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:57.654988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:57.782236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:57.785746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:57.790695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-283f2e31-9d1d-4e90-a165-d0b3975ed990 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.149722 Oct 23 20:16:57.791270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 540/1116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:57 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:58.813571 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:58.814205 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:58.816482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:58.822030 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:58.822540 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:58.822963 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:58.823638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:58.824085 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:58.824502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:58.949451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:16:58.957176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2a6b3896-592e-4287-a64b-318c1c60bdf1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.147465 Oct 23 20:16:58.957740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 577/1117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:58 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:16:59.980726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:16:59.981291 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:16:59.983069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:59.983702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:16:59.991131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:59.991613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:59.992045 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:16:59.993270 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:16:59.993726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:16:59.994149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:00.121933 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:00.129600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a42affec-82d6-4fa0-82fc-1497e0b09b05 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.153381 Oct 23 20:17:00.130160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 541/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:16:59 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:01.153306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:01.153858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:01.156214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:01.161276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:01.161773 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:01.162202 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:01.162916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:01.163363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:01.163966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:01.368151 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:01.375882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-09267ffc-5b56-4eac-a955-5c938a03c882 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.227130 Oct 23 20:17:01.376533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 578/1119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:01 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:02.399921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:02.400666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:02.404373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:02.408065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:02.408547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:02.409156 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:02.409854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:02.410325 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:02.410996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:02.562272 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:02.569905 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e06de3fc-9aaf-46c3-98f9-c268ea385231 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.174336 Oct 23 20:17:02.570515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 542/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:02 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:03.593407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:03.594052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:03.606548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:03.607037 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:03.607474 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:03.608176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:03.608953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:03.609384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:03.761433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:03.770868 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-ee717d33-69a7-4382-b8c3-bb379ba6bc4a tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.180647 Oct 23 20:17:03.771465 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 579/1121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:03 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:04.793536 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:04.794153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:04.800962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:04.801570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:04.802012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:04.802734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:04.803192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:04.803615 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:04.958591 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:04.968811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f4e1ad1b-2617-4446-8141-cfb7795d25d7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.179494 Oct 23 20:17:04.969496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 543/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:04 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:05.991711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:05.993603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:06.006821 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:06.015956 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:06.017690 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:06.030874 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:06.031440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:06.031886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:06.188552 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:06.198140 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-3be33aa6-3eb6-4a88-9791-f84eb17e36e8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.210215 Oct 23 20:17:06.199274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 580/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:05 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:07.225312 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:07.229046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c571552-4e80-4170-9cc6-aa8ccb5a180a", "name": "network-vif-plugged", "status": "completed", "tag": "52aa7e62-de00-4e05-aae6-56a7a696b6e7"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:07.229653 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:07.244153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:07.244971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:07.245828 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:07.247805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:07.248350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:07.249429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:07.251444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:07.252093 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:07.252968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:07.262723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] Creating event network-vif-plugged:52aa7e62-de00-4e05-aae6-56a7a696b6e7 for instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a on hv-cinder-86243 Oct 23 20:17:07.276659 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-cd52afb8-a89f-4c6d-85a9-bc0fe1378351 req-3d8c2456-fde0-46ba-b86c-266018e30e5e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333837 Oct 23 20:17:07.277515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 544/1124] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:07.557617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:07.567792 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-92ff1aa3-58f7-46f3-88d3-c200139f66aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.349977 Oct 23 20:17:07.578237 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 581/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:07 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:08.597818 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:08.599132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:08.610083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:08.610884 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:08.611324 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:08.612034 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:08.612495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:08.612922 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:08.789311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:08.798081 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a879622e-84c7-4548-a6f8-1c563d9574d1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1368 microversion: 2.1 time: 0.208406 Oct 23 20:17:08.800295 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 545/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:08 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:09.494136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:09.494779 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:09.503264 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:09.504034 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:09.504687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:09.505670 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:09.506384 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:09.507046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:09.617067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lazy-loading 'services' on Instance uuid 88d88de2-7c8e-4437-9246-01edb001924b {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:17:09.717629 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cc6fa669-0cc8-4861-9dc2-995edf348e42 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "DELETE /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b/os-volume_attachments/716d9ecb-6f28-4b9f-a786-f069cd7c0632" status: 202 len: 0 microversion: 2.1 time: 0.228265 Oct 23 20:17:09.719050 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 582/1127] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:17:09 2022] DELETE /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b/os-volume_attachments/716d9ecb-6f28-4b9f-a786-f069cd7c0632 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:17:09.839102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:09.840552 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:09.855690 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:09.856290 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:09.856859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:09.859512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:09.862528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:09.863499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:10.221093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:10.232366 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d256a7fd-605b-4550-bdda-bc7b3f6a1374 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1559 microversion: 2.1 time: 0.404958 Oct 23 20:17:10.234647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 546/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:09 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:10.261392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:10.263622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:10.271779 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:10.272828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:10.273527 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:10.288092 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:10.289711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:10.292238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:10.460403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-61b3f8b5-8a3f-4b60-b7a2-739a661a3399 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204030 Oct 23 20:17:10.461026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 583/1129] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:17:10 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:10.910850 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:10.911389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:10.925412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:10.926189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:10.928715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:10.929646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:10.932771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:10.933425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:10.998649 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:17:11.122640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-35fa5791-50f7-4ed9-abdb-808c7abc1177 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "DELETE /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 204 len: 0 microversion: 2.1 time: 0.215314 Oct 23 20:17:11.128852 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 547/1130] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:17:10 2022] DELETE /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 20:17:11.132723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:11.133889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:11.140395 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:11.140888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:11.141325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:11.142026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:11.142526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:11.142952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:11.387167 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:11.401554 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b91dedb5-f7a1-4255-b418-0f38c99b9b64 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1513 microversion: 2.1 time: 0.273083 Oct 23 20:17:11.405846 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 584/1131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:11 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:11.733143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c571552-4e80-4170-9cc6-aa8ccb5a180a", "tag": "52aa7e62-de00-4e05-aae6-56a7a696b6e7"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:11.745521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:11.746321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:11.749386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:11.778743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] Creating event network-changed:52aa7e62-de00-4e05-aae6-56a7a696b6e7 for instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a on hv-cinder-86243 Oct 23 20:17:11.786951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-60a635b5-4a06-4b71-af5c-43079c672365 req-ce3fd36b-a7c4-44d2-ae17-56d64c86451c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057869 Oct 23 20:17:11.787940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 548/1132] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:12.042533 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-32f85bd3-95ea-4903-a8a3-86114d4bfeb5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Action: 'create', calling method: .version_select at 0x7f64f035cf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1674619008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfUwnZMhktBp+MmrbLEIUGOZk/gNBFkRczsRLyFDO15RzDMg76kTDXQ4nhvdRWksNff0l0ixfguNVF0n8cMkC/AKn+OLttGd9Sk740gdR5Tr877945ChKqR0ri553Wq8A=="}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:12.058933 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-32f85bd3-95ea-4903-a8a3-86114d4bfeb5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:17:12.063028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-32f85bd3-95ea-4903-a8a3-86114d4bfeb5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for user 2e15e1e499874c01b8d9b4aec9f9eb9c and project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'key_pairs'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:17:12.088988 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-32f85bd3-95ea-4903-a8a3-86114d4bfeb5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.179441 Oct 23 20:17:12.089602 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 585/1133] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:17:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:12.439227 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:12.440609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:12.467925 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:12.468429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:12.468864 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:12.469573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:12.470026 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:12.470485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:12.748520 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:12.762697 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b8a938d9-c229-4044-a54b-caea655f9df6 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1513 microversion: 2.1 time: 0.336904 Oct 23 20:17:12.763751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 549/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:12 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:13.793725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:13.794973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:13.811596 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:13.812050 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:13.812408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d88de2-7c8e-4437-9246-01edb001924b", "name": "network-vif-deleted", "tag": "1ed93978-2e8e-4a55-b148-38b74cd6213d"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:13.813185 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:13.814384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:13.815005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:13.815581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:13.830666 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:13.831064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:13.831492 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:13.846997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] Creating event network-vif-deleted:1ed93978-2e8e-4a55-b148-38b74cd6213d for instance 88d88de2-7c8e-4437-9246-01edb001924b on hv-cinder-86243 Oct 23 20:17:13.852953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-3fcce8cd-8429-4646-ad4b-6bad267d6e23 req-f0e2e3e2-3fd1-4c9d-8f3a-e5fc56ddf8fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142848 Oct 23 20:17:13.853906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 586/1135] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:13.866955 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:13.868136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:13.868582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:13.869020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lazy-loading 'fault' on Instance uuid 88d88de2-7c8e-4437-9246-01edb001924b {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:17:13.923802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:13.933695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-56ff8620-53ac-41b0-b006-d5f20657badd tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 200 len: 1309 microversion: 2.1 time: 0.148842 Oct 23 20:17:13.934489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 550/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:13 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:14.960600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:14.961324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 88d88de2-7c8e-4437-9246-01edb001924b] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:14.967351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:14.967828 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:14.968254 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:14.969003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:14.969451 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:14.969871 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:14.986358 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] HTTP exception thrown: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Request method failure captured: Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b HTTP/1.1 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaEAd72X79Ur98dQ-UHobtZbGY2f7af1jQhS_J4a33DLR7p3_Z9RTw6JrLRswmhM5EdAOl3Q3ssxMTmVjV4jT1-EdSICe_KYXocHvQP5JA12gGiY9un2U21hr0bpiuCojzi3h8HqxwyYDR9rNRPq77lLI5gaE3_Os8p_SPpa9y-Bzi4 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 0df26e575de34eda9d416de65ec13036 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:17:14.988100 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0df26e575de34eda9d416de65ec13036", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0df26e575de34eda9d416de65ec13036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0df26e575de34eda9d416de65ec13036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0df26e575de34eda9d416de65ec13036"}]}] Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 0df26e575de34eda9d416de65ec13036 Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-VolumesSnapshotTestJSON-1139882648-project Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 52c576b9f49b4900ac5ba707aba78c27 Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139882648-project Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. Oct 23 20:17:14.989678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '88d88de2-7c8e-4437-9246-01edb001924b'} Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:17:14.994419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. Oct 23 20:17:14.995917 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:17:14.997259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Returning 404 to user: Instance 88d88de2-7c8e-4437-9246-01edb001924b could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:17:14.997259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-94ec00f5-cffd-427b-9d1f-e115c290c9cc tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b" status: 404 len: 111 microversion: 2.1 time: 0.033647 Oct 23 20:17:14.997259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 587/1137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:14 2022] GET /compute/v2.1/servers/88d88de2-7c8e-4437-9246-01edb001924b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:17:30.073981 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-576790172", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "networks": [{"uuid": "f06d0ad6-fb4a-4030-ac73-03fa0d42c27b"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:30.084075 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:30.084737 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:30.129970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] validate_networks() for [('f06d0ad6-fb4a-4030-ac73-03fa0d42c27b', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:17:30.552468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:17:30.552887 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:17:30.553352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:17:30.553753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:17:30.554187 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:17:30.563265 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:30.563740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:30.564166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:30.564910 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:30.565357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:30.565931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:30.582463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Getting quotas for project 0df26e575de34eda9d416de65ec13036. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:17:30.586299 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Getting quotas for user 52c576b9f49b4900ac5ba707aba78c27 and project 0df26e575de34eda9d416de65ec13036. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:17:30.597355 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:17:30.599608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:17:30.645718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3b2937ed-9bbe-45bb-9b47-a7e97fdc1b0e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575525 Oct 23 20:17:30.646463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 551/1138] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:17:30.658096 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-39f3775a-c2d2-432f-aa87-2e61974b12c2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:30.658723 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-39f3775a-c2d2-432f-aa87-2e61974b12c2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:30.662063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=4 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:30.662818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:30.664145 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:30.727003 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-39f3775a-c2d2-432f-aa87-2e61974b12c2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:30.734342 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-39f3775a-c2d2-432f-aa87-2e61974b12c2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1218 microversion: 2.1 time: 0.080051 Oct 23 20:17:30.734898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 588/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:30 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:31.757308 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:31.757846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:31.764340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:31.765548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:31.766165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:31.767061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:31.767672 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:31.768247 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:31.842754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:31.850889 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-25e9fa20-2684-416d-8674-011176c033be tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1278 microversion: 2.1 time: 0.097956 Oct 23 20:17:31.851753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 552/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:31 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:32.875895 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:32.876434 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:32.884441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:32.884920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:32.885572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:32.886256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:32.886718 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:32.887131 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:33.017487 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:33.025619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-7f603abc-9f63-434f-94ff-3659d078ccd5 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.154199 Oct 23 20:17:33.026187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 589/1141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:32 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:33.107125 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e", "tag": "a8869223-20e7-49a9-819c-4e545a764326"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:33.119339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:33.119924 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:33.120580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:33.132951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] Creating event network-changed:a8869223-20e7-49a9-819c-4e545a764326 for instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e on hv-cinder-86243 Oct 23 20:17:33.137794 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-bdd49af6-c6a0-4ae0-b556-ddc5edd09709 req-e78f1afe-4a2f-41c0-a9af-108b3ff9e5b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 Oct 23 20:17:33.138865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 553/1142] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:34.049064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:34.049668 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:34.056095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:34.056562 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:34.056985 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:34.057656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:34.058102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:34.058545 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:34.183702 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:34.191889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-edb4775c-3086-4640-a83d-df2872d385e7 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.147188 Oct 23 20:17:34.192449 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 590/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:34 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:35.215034 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:35.215725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:35.222204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:35.222708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:35.223133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:35.223806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:35.224252 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:35.224669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:35.352183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:35.359708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-222c0b1d-90fd-42e0-9ce8-af17ac56ef35 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.149042 Oct 23 20:17:35.360262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 554/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:35 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:36.382783 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:36.383387 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:36.390158 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:36.390669 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:36.391090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:36.391763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:36.392209 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:36.392624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:36.519745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:36.527211 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a36ecc51-1d4f-4691-a34c-8530d569840f tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.148277 Oct 23 20:17:36.527796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 591/1145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:36 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:37.548972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:37.549581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:37.555745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:37.556224 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:37.556655 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:37.557346 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:37.557796 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:37.558223 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:37.685717 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:37.693774 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-672a0295-3de3-4ed3-8fc1-444b02c6c541 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.148689 Oct 23 20:17:37.694372 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 555/1146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:37 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:38.716471 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:38.717073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:38.724042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:38.724515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:38.724946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:38.725619 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:38.726069 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:38.726507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:38.858715 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:38.866262 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d26eb2d5-3d3f-47ad-893a-ba951e3813a9 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.153644 Oct 23 20:17:38.866937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 592/1147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:38 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:39.634518 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-346290184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1674619008", "security_groups": [{"name": "tempest-secgroup-smoke-7927693"}], "block_device_mapping_v2": [{"uuid": "ca7ee453-ec12-44e9-9fba-2eb31dadc0de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfd87eb0-6e12-4670-accf-38eb6ce06b92"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:39.744515 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] validate_networks() for [('dfd87eb0-6e12-4670-accf-38eb6ce06b92', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:17:39.888782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:39.890070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:39.896375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:39.896849 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:39.897290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:39.897955 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:39.898435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:39.898847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:40.385555 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:40.393738 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-f36dc67d-8b1f-49de-ae2c-c9a9c252eb02 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.508748 Oct 23 20:17:40.394354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 593/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:39 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:40.444606 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:17:40.445023 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:17:40.445493 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:17:40.445892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:17:40.446701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:17:40.456089 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:40.456566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:40.456991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:40.457704 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:40.458151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:40.458591 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:40.474470 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:17:40.478325 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for user 2e15e1e499874c01b8d9b4aec9f9eb9c and project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:17:40.534114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:17:40.536298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca7ee453-ec12-44e9-9fba-2eb31dadc0de',volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:17:40.661283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cd32332e-2eb1-4f8f-af42-50789716ff87 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.030517 Oct 23 20:17:40.662212 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 556/1149] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:17:39 2022] POST /compute/v2.1/servers => generated 403 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:17:40.674036 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b2575b81-4765-44bb-95eb-d47a08384f7a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:40.674706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b2575b81-4765-44bb-95eb-d47a08384f7a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:40.732523 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-b2575b81-4765-44bb-95eb-d47a08384f7a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:40.735246 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:40.741570 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b2575b81-4765-44bb-95eb-d47a08384f7a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1094 microversion: 2.1 time: 0.072342 Oct 23 20:17:40.742137 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 594/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:40 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:41.037809 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e", "name": "network-vif-plugged", "status": "completed", "tag": "a8869223-20e7-49a9-819c-4e545a764326"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:41.049160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:41.049647 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:41.050329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:41.060998 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] Creating event network-vif-plugged:a8869223-20e7-49a9-819c-4e545a764326 for instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e on hv-cinder-86243 Oct 23 20:17:41.066577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-f2e69280-ab15-4aae-a1e2-3eb211417dcd req-cf543284-6ad3-4b93-a6f5-cea5b8198bc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 Oct 23 20:17:41.067307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 557/1151] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:41.416301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:41.416937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:41.424261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:41.424734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:41.425159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:41.425835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:41.426306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:41.426831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:41.551240 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:41.558694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9f93e96f-17f2-467d-965e-5cf6d71c333e tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.146243 Oct 23 20:17:41.559256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 595/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:41 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:41.766414 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:41.767135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:41.773128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:41.773605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:41.774031 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:41.774738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:41.775189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:41.775607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:41.838805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:41.846793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bcedf182-6863-4574-8ece-6c7f8364e896 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1192 microversion: 2.1 time: 0.085620 Oct 23 20:17:41.847497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 558/1153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:41 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:42.581593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:42.582377 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:42.589376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:42.590181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:42.590707 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:42.591496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:42.591959 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:42.592382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:42.737774 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:42.746730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-563782ac-3bab-4237-bb04-787046ed7f98 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1318 microversion: 2.1 time: 0.169152 Oct 23 20:17:42.747517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 596/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:42 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:42.870948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:42.871563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:42.878605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:42.879199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:42.879768 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:42.880562 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:42.881174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:42.881919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:42.944930 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:42.953993 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-fcc1e74c-539f-4c14-8765-4a0de731ae5a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1210 microversion: 2.1 time: 0.087827 Oct 23 20:17:42.954587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 559/1155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:42 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:43.769542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:43.774381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:43.783229 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.783711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.784143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:43.784844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.785398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.785822 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:43.921568 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:43.929436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d79d6f71-fe52-41bc-81ea-64307317a687 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1506 microversion: 2.1 time: 0.163756 Oct 23 20:17:43.930403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 597/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:43 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:43.952980 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6780ebb8-c839-4b6c-be99-71b51933f479", "device": "/dev/sdb"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:43.955495 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:43.961527 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.962012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.962475 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:43.963164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.963612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.964025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:43.976835 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:43.977553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:43.984363 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.985136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.985796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:43.986685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:43.987245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:43.987848 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:44.147975 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:44.156074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-89a2f0dd-1a26-47ce-9bc4-3ea6895fc71a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.183098 Oct 23 20:17:44.157015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 598/1157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:43 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:44.161599 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831a4d3c-4e7f-4c11-b83a-92ba72480b30", "tag": "0b0c65ed-87d3-4416-8478-c6c50775a20d"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:17:44.170744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:44.171505 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:44.172132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:44.185103 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] Creating event network-changed:0b0c65ed-87d3-4416-8478-c6c50775a20d for instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 on hv-cinder-86243 Oct 23 20:17:44.191906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-775c7005-2bc5-44ce-8456-8ed456379a5a req-7560dfad-1edf-41ed-a0e1-0fc891c5d704 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033453 Oct 23 20:17:44.192757 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 599/1158] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:44.255256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f167b384-a337-4ae5-b000-1521477f88a4 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "POST /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306394 Oct 23 20:17:44.255902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 560/1159] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:17:43 2022] POST /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:17:45.179740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:45.180432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:45.188165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:45.189044 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:45.189169 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:45.189768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:45.190378 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:45.190873 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:45.319462 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:45.328976 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-24f77b91-c75e-4320-99e1-11bef5f37cb9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153394 Oct 23 20:17:45.329546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 600/1160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:45 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:46.352797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:46.353529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:46.360117 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:46.360598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:46.361032 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:46.361711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:46.362163 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:46.362616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:46.494556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:46.502666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cfd34e71-19d6-4617-9f2b-dc87c4bb5611 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.154136 Oct 23 20:17:46.503231 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 561/1161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:46 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:47.525450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:47.526055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:47.533351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:47.533826 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:47.534274 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:47.534957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:47.535406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:47.535827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:47.663360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:47.670938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d2407f4e-258c-47e5-8d23-4e0bfb6634b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.149265 Oct 23 20:17:47.671499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 601/1162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:47 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:48.692914 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:48.693464 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:48.700021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:48.700759 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:48.701198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:48.701907 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:48.702394 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:48.702824 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:48.835039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:48.843180 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-53aa347a-21ff-4dcf-a0f2-a30ec56b88d5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153662 Oct 23 20:17:48.843751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 562/1163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:48 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:49.866483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:49.867026 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:49.873399 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:49.874513 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:49.874944 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:49.875623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:49.876077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:49.876499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:50.008252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:50.016046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-77ff40f1-4c4d-4809-a4f5-eea30f09c7d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153473 Oct 23 20:17:50.016819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 602/1164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:49 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:51.039062 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:51.039667 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:51.042078 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=4 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:51.042764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=12 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:51.049503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:51.049985 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:51.050448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:51.051200 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:51.051734 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:51.052160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:51.180579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:51.188330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b904167a-9356-4cad-aa82-11213eceef24 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153167 Oct 23 20:17:51.188899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 563/1165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:51 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:52.211656 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:52.212239 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:52.214227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:17:52.219954 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:52.220437 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:52.220863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:52.221541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:52.221989 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:52.222443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:52.352990 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:52.361141 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6b818169-e02b-4131-bb97-5caea4c7666f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153613 Oct 23 20:17:52.361708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 603/1166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:52 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:53.383104 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:53.383710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:53.390695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:53.391165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:53.391589 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:53.392262 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:53.392708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:53.393121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:53.520164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:53.527674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3a68892e-81ae-40f2-847a-2ba9a46cd4d4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.148475 Oct 23 20:17:53.528240 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 564/1167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:53 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:54.551031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:54.551638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:54.558035 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:54.558546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:54.558977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:54.559662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:54.560115 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:54.560536 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:54.690813 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:54.698433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1ce5fa5d-07c9-4904-8a6b-5f9d572865ca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.151258 Oct 23 20:17:54.699002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 604/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:54 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:55.721079 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:55.721613 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:55.728284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:55.728764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:55.729196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:55.729883 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:55.730377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:55.730799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:55.858755 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:55.866362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8a62765f-599b-4452-9f9c-bf6de32de8c2 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.149178 Oct 23 20:17:55.866937 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 565/1169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:55 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:56.889934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:56.890569 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:56.897002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:56.897486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:56.897922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:56.898642 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:56.899106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:56.899529 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:57.027242 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:57.035691 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a2d383ea-4ba8-4e37-a003-93a9af6da2a4 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.149636 Oct 23 20:17:57.036252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 605/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:56 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:17:58.058813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:58.059429 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:58.066478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:58.066966 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:58.067400 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:58.068481 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:58.068580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:58.068939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:58.210276 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:58.221150 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3a8e1b9f-f0d8-4c76-8bf2-950009adf178 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.166173 Oct 23 20:17:58.222012 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 566/1171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:58 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:17:59.245847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:17:59.246491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:17:59.254220 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:59.254734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:59.255166 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:59.255851 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:17:59.256305 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:17:59.256724 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:17:59.384953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:17:59.393268 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1369b17e-3064-46b3-9e2a-759c9801a7c9 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.151277 Oct 23 20:17:59.393823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 606/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:17:59 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:00.414727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:00.415343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:00.417631 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:00.423504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:00.423989 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:00.424425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:00.425113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:00.425565 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:00.425984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:00.430687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:00.559369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:00.566991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3168e0f3-b8f5-40d7-b858-d63236be1add tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.156091 Oct 23 20:18:00.567556 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 567/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:00 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:01.589747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:01.590298 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:01.592551 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=43 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:01.598161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:01.598676 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:01.599112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:01.599837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:01.600292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:01.600719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:01.603326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=99 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:01.728245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:01.736310 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-4e81c8ca-811e-48cc-9b51-b4808d7ec36a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.150481 Oct 23 20:18:01.736873 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 607/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:01 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:02.590164 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a4d3c-4e7f-4c11-b83a-92ba72480b30", "name": "network-vif-plugged", "status": "completed", "tag": "0b0c65ed-87d3-4416-8478-c6c50775a20d"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:18:02.601008 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:02.601512 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:02.601950 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:02.614122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] Creating event network-vif-plugged:0b0c65ed-87d3-4416-8478-c6c50775a20d for instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 on hv-cinder-86243 Oct 23 20:18:02.619108 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-b026e446-d912-45fe-90f9-aad28e190fa4 req-491f595d-cd1e-4afe-999b-fa091a21238a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Oct 23 20:18:02.619741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 568/1175] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:18:02.759789 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:02.760467 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:02.768223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:02.769129 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:02.769681 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:02.770526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:02.771364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:02.771841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:02.904992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:02.912685 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-27b9084c-16e4-49db-ab78-1b6b291a627e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.157324 Oct 23 20:18:02.913259 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 608/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:02 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:03.937476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:03.938208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:03.944375 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:03.944858 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:03.945293 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:03.945973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:03.946459 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:03.946880 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:04.078523 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:04.086136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c1819417-c2d5-4714-8a67-d2c5e990e227 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1263 microversion: 2.1 time: 0.153908 Oct 23 20:18:04.086740 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 569/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:03 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:05.107993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:05.108630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:05.115165 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:05.115638 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:05.116065 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:05.116737 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:05.117184 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:05.117601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:05.244596 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:05.252810 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-080577ea-7d6e-4c08-9342-ed26c32c532e tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1450 microversion: 2.1 time: 0.148640 Oct 23 20:18:05.253372 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 609/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:05 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:05.275184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:05.275732 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:05.282030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:05.282544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:05.282978 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:05.283666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:05.284124 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:05.284547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:05.417022 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:05.425217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6b17db87-1c2e-45e8-abad-c211f2925496 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1450 microversion: 2.1 time: 0.153881 Oct 23 20:18:05.425784 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 570/1179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:05 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:06.728573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:06.729143 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:06.735580 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:06.736132 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:06.736640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:06.737334 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:06.737793 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:06.738215 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:06.820827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lazy-loading 'services' on Instance uuid 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:18:06.894839 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cd28812f-a86f-4406-9ab3-987f3d2e3356 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e/os-volume_attachments/6780ebb8-c839-4b6c-be99-71b51933f479" status: 202 len: 0 microversion: 2.1 time: 0.169967 Oct 23 20:18:06.895640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 610/1180] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:18:06 2022] DELETE /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e/os-volume_attachments/6780ebb8-c839-4b6c-be99-71b51933f479 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:18:07.025871 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831a4d3c-4e7f-4c11-b83a-92ba72480b30", "tag": "0b0c65ed-87d3-4416-8478-c6c50775a20d"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:18:07.036340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:07.037039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:07.037462 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:07.049086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] Creating event network-changed:0b0c65ed-87d3-4416-8478-c6c50775a20d for instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 on hv-cinder-86243 Oct 23 20:18:07.054131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-cf5f4dee-bd84-44c3-b11b-94b67a6afe12 req-b83b0ebd-0123-41ac-bdd6-273e752c21a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032235 Oct 23 20:18:07.054767 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 571/1181] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:18:08.026840 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:08.027423 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:08.036878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:08.037364 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:08.037792 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:08.038538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:08.038988 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:08.039403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:08.067116 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:18:08.147436 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b6794647-219d-4e56-8c25-08539d4e8548 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 204 len: 0 microversion: 2.1 time: 0.124590 Oct 23 20:18:08.148061 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 611/1182] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:18:08 2022] DELETE /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:18:08.158497 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:08.159189 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:08.165424 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:08.165901 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:08.166402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:08.167087 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:08.167535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:08.167953 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:08.307961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:08.316357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a8a58d6e-989e-4b9f-abb0-e91c08e2e268 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1512 microversion: 2.1 time: 0.162778 Oct 23 20:18:08.317371 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 572/1183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:08 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:09.340064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:09.340763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:09.347957 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:09.348433 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:09.348862 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:09.349542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:09.350068 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:09.350774 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:09.481855 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:09.489777 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2da66a27-5793-43c8-858a-7d3914ad18db tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1512 microversion: 2.1 time: 0.153888 Oct 23 20:18:09.490375 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 612/1184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:09 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:10.513138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:10.514410 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:10.522065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:10.522826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:10.524528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:10.525627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:10.526101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:10.526573 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:10.593146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e", "name": "network-vif-deleted", "tag": "a8869223-20e7-49a9-819c-4e545a764326"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:18:10.596446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c576b9f49b4900ac5ba707aba78c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df26e575de34eda9d416de65ec13036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:18:10.605151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-198d1579-70e6-4b3d-899a-b36811de6ed2 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 200 len: 1470 microversion: 2.1 time: 0.095878 Oct 23 20:18:10.605588 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:10.606076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:10.606538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:10.618623 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 573/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:10 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 1470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:18:10.619678 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] Creating event network-vif-deleted:a8869223-20e7-49a9-819c-4e545a764326 for instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e on hv-cinder-86243 Oct 23 20:18:10.625172 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-58dd62f3-752c-4cde-b32d-138e8949169d req-fe469844-77c4-4058-a8c5-ffb35b0f0e1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036552 Oct 23 20:18:10.625937 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 613/1186] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:18:11.629764 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:11.630330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] [instance: 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:11.636698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:11.637176 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:11.637617 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:11.638329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:11.639277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:11.639701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:11.652750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] HTTP exception thrown: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Request method failure captured: Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e HTTP/1.1 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaEAd72X79Ur98dQ-UHobtZbGY2f7af1jQhS_J4a33DLR7p3_Z9RTw6JrLRswmhM5EdAOl3Q3ssxMTmVjV4jT1-EdSICe_KYXocHvQP5JA12gGiY9un2U21hr0bpiuCojzi3h8HqxwyYDR9rNRPq77lLI5gaE3_Os8p_SPpa9y-Bzi4 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 0df26e575de34eda9d416de65ec13036 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:18:11.655102 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0df26e575de34eda9d416de65ec13036", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0df26e575de34eda9d416de65ec13036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0df26e575de34eda9d416de65ec13036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0df26e575de34eda9d416de65ec13036"}]}] Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 0df26e575de34eda9d416de65ec13036 Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139882648 Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-VolumesSnapshotTestJSON-1139882648-project Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 52c576b9f49b4900ac5ba707aba78c27 Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139882648-project Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. Oct 23 20:18:11.656849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e'} Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:18:11.657942 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. Oct 23 20:18:11.659656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:18:11.661271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] Returning 404 to user: Instance 22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:18:11.661271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-07901acd-b8ff-4a87-a38d-b7c833cd8916 tempest-VolumesSnapshotTestJSON-1139882648 tempest-VolumesSnapshotTestJSON-1139882648-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e" status: 404 len: 111 microversion: 2.1 time: 0.030670 Oct 23 20:18:11.661271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 574/1187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:18:11 2022] GET /compute/v2.1/servers/22eb9b9f-6a76-48ad-a6ac-3fb86dbd342e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:18:54.204032 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:54.204764 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:54.420615 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:18:54.421198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:54.427327 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:54.427798 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:54.428227 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:54.428903 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:54.429356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:54.429772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:54.453863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-c3e30dc4-dde9-417a-ad2d-ea30591fb45c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/ips" status: 200 len: 151 microversion: 2.1 time: 0.255760 Oct 23 20:18:54.454444 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 614/1188] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:18:54 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/ips => generated 151 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:18:55.776249 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9977a0c6-e37f-4a0e-890f-f12e12fc8c56"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:18:55.778622 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:18:55.781384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=15 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:55.782030 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=35 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:55.787892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:55.788377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:55.788813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:55.789504 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:18:55.789961 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:18:55.790427 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:18:56.023198 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-7ba4a66a-1295-4fdb-ae14-1e72779c9c48 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250464 Oct 23 20:18:56.023602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 575/1189] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:18:55 2022] POST /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:03.554731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9977a0c6-e37f-4a0e-890f-f12e12fc8c56"}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:03.557159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:03.563531 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.564021 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.564456 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.565146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.565603 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.566028 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.642234 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: POST /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments HTTP/1.1 Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 74 Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:19:03.644041 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {"volumeAttachment": {"volumeId": "9977a0c6-e37f-4a0e-890f-f12e12fc8c56"}} Oct 23 20:19:03.645739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'server_id': '3c571552-4e80-4170-9cc6-aa8ccb5a180a', 'body': {'volumeAttachment': {'volumeId': '9977a0c6-e37f-4a0e-890f-f12e12fc8c56'}}} Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:19:03.647573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:03.649045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 400 to user: Invalid volume: volume 9977a0c6-e37f-4a0e-890f-f12e12fc8c56 is already attached to instances: 3c571552-4e80-4170-9cc6-aa8ccb5a180a {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-cc0b5eca-d390-4003-a812-1b52550d993d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094710 Oct 23 20:19:03.650640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 615/1190] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:19:03 2022] POST /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 20:19:03.711448 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:03.712040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:03.718651 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.719129 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.719587 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.720250 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.720701 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.721123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.800598 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.objects.instance [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lazy-loading 'services' on Instance uuid 3c571552-4e80-4170-9cc6-aa8ccb5a180a {{(pid=118866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:19:03.871819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-1d6432c4-bd1e-486a-87e1-956539ab42c3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments/9977a0c6-e37f-4a0e-890f-f12e12fc8c56" status: 202 len: 0 microversion: 2.1 time: 0.164995 Oct 23 20:19:03.872402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 576/1191] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:19:03 2022] DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments/9977a0c6-e37f-4a0e-890f-f12e12fc8c56 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:19:03.880714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:03.882880 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:03.891243 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.891644 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.892150 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.892844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:03.893297 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:03.893740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:03.925987 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-348ee7ba-69ff-4050-8b2a-cdda9d554c89 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Oct 23 20:19:03.926559 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 616/1192] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:19:03 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:04.939826 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:04.942153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:04.948271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:04.948744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:04.949172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:04.949847 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:04.950315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:04.950991 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:04.980793 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0c0ea1e1-0bba-43b2-bd61-6ce171ea4c9c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046345 Oct 23 20:19:04.981330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 577/1193] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:19:04 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:19:05.044710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:05.045811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:05.052248 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:05.052726 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:05.053156 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:05.053837 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:05.054307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:05.054730 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:05.079064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:19:05.151486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0890870d-868b-4f06-9e88-b5166107afc8 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 204 len: 0 microversion: 2.1 time: 0.110413 Oct 23 20:19:05.152073 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 617/1194] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:19:05 2022] DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:19:05.160695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:05.161312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:05.167457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:05.167944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:05.168411 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:05.169103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:05.169561 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:05.169990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:05.302835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:05.310487 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a13b4633-880f-484f-b99a-f1308c37f496 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1684 microversion: 2.1 time: 0.153642 Oct 23 20:19:05.311055 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 578/1195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:05 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:06.333816 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:06.334544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:06.340888 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:06.341367 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:06.341799 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:06.342526 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:06.342980 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:06.343407 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:06.470339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:06.477924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9e351881-fb96-4095-afbd-f298f8255291 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1684 microversion: 2.1 time: 0.148418 Oct 23 20:19:06.478525 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 618/1196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:06 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:07.501513 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:07.502115 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:07.508940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:07.509287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:07.509747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:07.510608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:07.511088 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:07.511579 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:07.578664 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:07.586715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8c15ec42-a088-43ac-a64d-6f9769b67695 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 200 len: 1616 microversion: 2.1 time: 0.089596 Oct 23 20:19:07.587287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 579/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:07 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 1616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:07.815477 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c571552-4e80-4170-9cc6-aa8ccb5a180a", "name": "network-vif-deleted", "tag": "52aa7e62-de00-4e05-aae6-56a7a696b6e7"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:07.826102 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:07.826623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:07.827053 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:07.838916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] Creating event network-vif-deleted:52aa7e62-de00-4e05-aae6-56a7a696b6e7 for instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a on hv-cinder-86243 Oct 23 20:19:07.843733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-548ee40f-4db7-4e60-b732-623a25ddc692 req-733a14d0-e32a-420f-9965-209174e46989 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Oct 23 20:19:07.844728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 619/1198] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:08.609040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:08.609661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:08.616386 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:08.616867 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:08.617297 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:08.617996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:08.618474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:08.618898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:08.632542 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a HTTP/1.1 Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:19:08.634204 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:19:08.635875 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '3c571552-4e80-4170-9cc6-aa8ccb5a180a'} Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:19:08.636846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:19:08.638412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:19:08.640398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:19:08.640398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9c316fad-18ef-4931-9406-1e8459bf406b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 404 len: 111 microversion: 2.1 time: 0.030545 Oct 23 20:19:08.640398 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 580/1199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:08 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:19:08.645867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-888370e2-4bb2-456b-803f-e375a5bc77e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '.version_select at 0x7f64f03a5700>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:08.665806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-888370e2-4bb2-456b-803f-e375a5bc77e4 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484874508" status: 202 len: 0 microversion: 2.1 time: 0.024125 Oct 23 20:19:08.666522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 620/1200] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 23 20:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484874508 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 20:19:09.561811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: .version_select at 0x7f64f10fc0d0>, body: {"keypair": {"name": "tempest-keypair-435062568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEobq/rWxwRctPeGS0WEg4jWih1DhXOYIqrmoklguCcWeA1KlJpG82Dx1nYE07+Pm/s1FM/LVR+FxJW8cVbVRhUsQBpsBNSPAD4fZF7mOwsFnCwy1Y6TNwir9cQP9SsIMw=="}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:09.577331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:19:09.581036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'key_pairs'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:19:09.592945 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR oslo.messaging._drivers.impl_rabbit [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [8eb9bf2c-51da-4332-8661-b2d0c2523de3] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:19:10.600242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [8eb9bf2c-51da-4332-8661-b2d0c2523de3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50632. Oct 23 20:19:10.614558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-afe49b3b-8f8d-4615-b379-29d3583c06b7 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.056512 Oct 23 20:19:10.615160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 581/1201] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 23 20:19:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:12.041974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-738028680", "imageRef": "a63e128f-7c32-497d-8b88-ec3d9317f85f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d505897-a26b-4ba1-98e0-a78acd4b7259"}], "security_groups": [{"name": "tempest-securitygroup--2027635203"}], "key_name": "tempest-keypair-435062568", "user_data": "}} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:12.144429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.network.neutron [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] validate_networks() for [('5d505897-a26b-4ba1-98e0-a78acd4b7259', None, None, None, None, None)] {{(pid=118867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:19:12.588734 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:19:12.589191 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image limits 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:19:12.589663 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Flavor pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:19:12.590072 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Image pref 0:0:0 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:19:12.590541 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.virt.hardware [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:19:12.599819 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:12.600299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:12.600762 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:12.601491 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:12.601945 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:12.602402 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:12.619261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:19:12.623177 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.quota [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Getting quotas for user 10bbbf111f714b108435b58c5b6c2747 and project 71f456c92d544d0c81bcb2fe937188ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:19:12.634181 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Going to run 1 instances... {{(pid=118867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:19:12.636607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a63e128f-7c32-497d-8b88-ec3d9317f85f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:19:12.682800 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [df1bd5eb-9e38-4e72-a67d-5b84e6c822e6] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:19:13.690502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [df1bd5eb-9e38-4e72-a67d-5b84e6c822e6] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50660. Oct 23 20:19:13.694325 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8670b8e2-7abb-468b-9f31-f39b64445fcc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.656763 Oct 23 20:19:13.694972 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 621/1202] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:19:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:19:13.707445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3fa5f6a5-3e2c-4f04-84bf-a02a7ee69bcd tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:13.708051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3fa5f6a5-3e2c-4f04-84bf-a02a7ee69bcd tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:13.760586 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3fa5f6a5-3e2c-4f04-84bf-a02a7ee69bcd tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:13.767553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3fa5f6a5-3e2c-4f04-84bf-a02a7ee69bcd tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1240 microversion: 2.1 time: 0.065228 Oct 23 20:19:13.768114 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 582/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:13 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:14.790515 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:14.791290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:14.798398 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:14.798881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:14.799340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:14.800055 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:14.800630 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:14.801117 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:14.862082 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:14.869687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-295ac01d-8f7c-45ee-9067-113aeda32baf tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1298 microversion: 2.1 time: 0.083730 Oct 23 20:19:14.870239 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 622/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:14 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:15.893941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:15.894577 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:15.901040 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:15.901524 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:15.901951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:15.902666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:15.903113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:15.903525 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:16.036103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:16.043735 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-a79aa5ff-90fc-476e-8295-bc6a8dc1e8f1 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.153946 Oct 23 20:19:16.044356 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 583/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:15 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:16.089938 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b69aacd-d9e1-4e56-ac6a-810be561e773", "tag": "35c91706-bf06-4191-8366-078e0ab89e0e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:16.104127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:16.104613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:16.105040 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:16.116058 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] Creating event network-changed:35c91706-bf06-4191-8366-078e0ab89e0e for instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 on hv-cinder-86243 Oct 23 20:19:16.120757 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-ef7ff288-0963-4b95-acbb-0e96adf10d1b req-901f2221-3b7a-4aff-8953-3dd63a304fbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034685 Oct 23 20:19:16.121350 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 623/1206] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:17.068098 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:17.068668 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:17.075086 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:17.075815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:17.076260 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:17.076939 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:17.077384 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:17.077798 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:17.205123 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:17.212906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-dae02e5c-a18c-49c0-8d18-c9450f953f5f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.148760 Oct 23 20:19:17.213472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 584/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:17 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:18.237306 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:18.237996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:18.244067 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:18.244540 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:18.244969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:18.245640 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:18.246087 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:18.246529 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:18.373503 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:18.381031 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-d2c59a04-b05d-4e73-974e-8cb4f5f30696 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.148924 Oct 23 20:19:18.381588 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 624/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:18 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:19.403300 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:19.403903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:19.411099 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:19.411566 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:19.412082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:19.412727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:19.413161 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:19.413588 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:19.542311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:19.550550 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-9c414bac-22bb-4ad8-b65b-40da26965b1f tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.151133 Oct 23 20:19:19.551128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 585/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:19 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:20.572939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:20.573543 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:20.580163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:20.580639 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:20.581086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:20.581748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:20.582198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:20.582643 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:20.708317 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:20.716009 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-54e704a9-0f34-4701-9154-8f9403c62191 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.146942 Oct 23 20:19:20.717080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 625/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:20 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:21.738808 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:21.739420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:21.745853 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:21.746369 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:21.746803 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:21.747482 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:21.748478 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:21.748900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:21.882029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:21.889822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-95d4d5ce-1660-409c-96f4-19d90b93203b tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.154851 Oct 23 20:19:21.890440 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 586/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:21 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:22.912262 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:22.912863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:22.915833 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:19:22.916484 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=6 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:19:22.922521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:22.922997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:22.923428 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:22.924113 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:22.924557 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:22.924966 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:22.972160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b69aacd-d9e1-4e56-ac6a-810be561e773", "name": "network-vif-plugged", "status": "completed", "tag": "35c91706-bf06-4191-8366-078e0ab89e0e"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:22.984334 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:22.985028 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:22.985656 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:22.997636 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] Creating event network-vif-plugged:35c91706-bf06-4191-8366-078e0ab89e0e for instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 on hv-cinder-86243 Oct 23 20:19:23.003711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-892305d2-95b6-4081-8272-cc56910ea7c3 req-6b89a0d5-b0c6-4554-8a9c-304522ff08eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Oct 23 20:19:23.004467 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 587/1212] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:19:23.078766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:23.086511 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-2b85ff30-73a2-4c71-b5c1-eaf3c5875c2e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.178012 Oct 23 20:19:23.087201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 626/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:22 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:24.106197 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:19:24.110856 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:24.111549 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:24.117842 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:24.118463 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:24.118903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:24.119582 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:24.120027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:24.120446 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:24.245918 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:24.253625 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-abd4e37e-e3f2-4849-8e1e-09c50ecc8308 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1366 microversion: 2.1 time: 0.148409 Oct 23 20:19:24.254197 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 588/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:24 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:25.276455 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:25.278261 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:25.279960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:19:25.285483 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:25.285969 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:25.286408 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:25.287086 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:25.287530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:25.287943 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:25.291052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:19:25.420665 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:19:25.428238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8f0bc9be-4f9f-42ee-890f-dc9123b3bad3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1556 microversion: 2.1 time: 0.155682 Oct 23 20:19:25.428796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 627/1215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:19:25 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:19:25.449899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:19:25.450676 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:19:25.457033 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:25.457522 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:25.457973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:25.458687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:25.459144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:25.459570 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:25.534127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-397fb3a4-2024-458c-9904-cba45ae19af3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088020 Oct 23 20:19:25.534813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 589/1216] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 23 20:19:25 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:19:26.422301 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b69aacd-d9e1-4e56-ac6a-810be561e773", "tag": "35c91706-bf06-4191-8366-078e0ab89e0e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:19:26.432045 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:19:26.432522 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:19:26.432948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:19:26.443623 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] Creating event network-changed:35c91706-bf06-4191-8366-078e0ab89e0e for instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 on hv-cinder-86243 Oct 23 20:19:26.448643 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-8d9ed9df-c2f0-449c-a785-6906772f60b1 req-00b9bd88-350f-4c5c-a7c5-a5e30cddd35a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030046 Oct 23 20:19:26.449748 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 628/1217] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:25.371318 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:25.372073 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:25.375984 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:25.377069 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:25.384208 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:25.384754 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:25.385121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:25.385805 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:25.386281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:25.386702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:25.411919 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:20:25.486401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3af783e1-3479-447d-9149-cf2139781f2c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "DELETE /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 204 len: 0 microversion: 2.1 time: 0.115867 Oct 23 20:20:25.487217 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 590/1218] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:25 2022] DELETE /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:20:25.497776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:25.498516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:25.500607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=3 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:25.501904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=7 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:25.508339 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:25.508827 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:25.509262 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:25.509962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:25.510447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:25.510872 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:25.640083 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:25.647771 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a72301f6-b5bf-4c1d-8829-0da2b5707a89 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1575 microversion: 2.1 time: 0.156293 Oct 23 20:20:25.648338 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 629/1219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:25 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:26.671838 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:26.672544 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:26.678972 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:26.679457 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:26.679890 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:26.680600 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:26.681061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:26.681479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:26.812044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:26.819750 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b72b9bf7-2883-448c-b29c-de68bf52daed tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1575 microversion: 2.1 time: 0.152179 Oct 23 20:20:26.820329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 591/1220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:26 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:27.843236 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:27.843870 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:27.851561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:27.852047 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:27.852478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:27.853196 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:27.853650 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:27.854070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:27.916382 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:27.924601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1eaaa524-4907-4cfb-ac44-07a27f74cdfe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 200 len: 1510 microversion: 2.1 time: 0.085201 Oct 23 20:20:27.925152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 630/1221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:27 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:27.988738 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a4d3c-4e7f-4c11-b83a-92ba72480b30", "name": "network-vif-deleted", "tag": "0b0c65ed-87d3-4416-8478-c6c50775a20d"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:28.002201 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:28.002813 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:28.003301 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:28.016007 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] Creating event network-vif-deleted:0b0c65ed-87d3-4416-8478-c6c50775a20d for instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 on hv-cinder-86243 Oct 23 20:20:28.025284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-9d9aa75e-5456-43b5-bbf7-59703a4f64c5 req-15598fa8-04bd-46cb-bde7-1887d48cc717 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041002 Oct 23 20:20:28.025970 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 592/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:28.947489 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:28.948095 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:28.954863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:28.955340 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:28.955766 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:28.956448 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:28.956927 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:28.957344 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:28.970898 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] HTTP exception thrown: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Request method failure captured: Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 HTTP/1.1 Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaFCB7bZHwNSyhQNLAt0wNE2olVobrJaFy9W0Sx3L-ExbzX1fI4EgxVuQlkfYC9UBV4U9ZNCH8e_7lSKwyhWrG2GxwLBEZLgYLiflaL5BbdjccRukAoBU0ljGkuRzw_yJeTkiVRLXVpMwIOQEtvgiDKzgUu6FQfsykOvL5ZmbTK_idg Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:20:28.972575 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_deacebf04e2d4a8093425ce7d16ca3cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}] Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 2e15e1e499874c01b8d9b4aec9f9eb9c Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:20:28.974328 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '831a4d3c-4e7f-4c11-b83a-92ba72480b30'} Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:28.975397 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:20:28.976993 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:28.978509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Returning 404 to user: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:28.978509 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-270a91a3-5b2e-4035-81d6-8069d6e111d3 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 404 len: 111 microversion: 2.1 time: 0.030403 Oct 23 20:20:28.978916 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 631/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:28 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:29.083168 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-991712324", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1674619008", "security_groups": [{"name": "tempest-secgroup-smoke-7927693"}], "block_device_mapping_v2": [{"uuid": "ca7ee453-ec12-44e9-9fba-2eb31dadc0de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfd87eb0-6e12-4670-accf-38eb6ce06b92"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:29.196428 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] validate_networks() for [('dfd87eb0-6e12-4670-accf-38eb6ce06b92', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:20:29.555373 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:20:29.555816 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:20:29.556283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:20:29.556681 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:20:29.557110 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:20:29.565669 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:29.566142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:29.566602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:29.567312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:29.567758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:29.568169 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:29.584460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:20:29.588280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for user 2e15e1e499874c01b8d9b4aec9f9eb9c and project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:20:29.643815 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:20:29.646013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca7ee453-ec12-44e9-9fba-2eb31dadc0de',volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:20:29.771521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [755f88ea-ec07-4dd3-81d8-2422cb240641] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:20:30.778442 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [755f88ea-ec07-4dd3-81d8-2422cb240641] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50762. Oct 23 20:20:30.782477 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-08b49598-351e-4784-b8f9-2ca1a287ba23 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.703614 Oct 23 20:20:30.783172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 593/1224] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:20:29 2022] POST /compute/v2.1/servers => generated 403 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:20:30.794112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-40a41536-c785-42ac-b623-d39cc84d7dcb tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:30.794747 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-40a41536-c785-42ac-b623-d39cc84d7dcb tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:30.897371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-40a41536-c785-42ac-b623-d39cc84d7dcb tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:30.908077 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-40a41536-c785-42ac-b623-d39cc84d7dcb tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1094 microversion: 2.1 time: 0.117166 Oct 23 20:20:30.908572 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 632/1225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:30 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:31.041284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:31.041782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:31.048151 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:31.048629 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:31.049061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:31.049745 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:31.050199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:31.050760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:31.080378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-230a8e3e-a8e3-4abd-a105-c61b45d89e01 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/ips" status: 200 len: 150 microversion: 2.1 time: 0.043394 Oct 23 20:20:31.080928 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 594/1226] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 23 20:20:31 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:31.929548 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:31.930796 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:31.937785 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:31.938295 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:31.938727 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:31.939419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:31.939867 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:31.940284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:32.016176 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:32.025204 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-5615f118-94c4-4c5f-b152-04cb5fabf592 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1210 microversion: 2.1 time: 0.099460 Oct 23 20:20:32.025778 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 633/1227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:31 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:32.446806 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56cf1469-fdca-4126-a2d5-eb52a3591f18"}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:32.449526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:32.456409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:32.456898 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:32.457338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:32.458013 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:32.458490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:32.458903 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:32.879674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c874f634-3053-48bb-8701-3816f5885f14 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "POST /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433552 Oct 23 20:20:32.899771 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 595/1228] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 23 20:20:32 2022] POST /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:33.049326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:33.049932 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:33.056245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:33.056725 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:33.057156 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:33.057843 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:33.058330 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:33.058759 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:33.208182 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:33.217507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9c852d06-6d94-4d64-99b9-098388ea58c6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.172533 Oct 23 20:20:33.218909 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 634/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:33 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:33.447139 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc2546-175f-4c4f-b755-b596d18abaf5", "tag": "db85ea01-b6c6-4b18-9915-7bad0bf62a09"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:33.460797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:33.461280 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:33.462011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:33.475990 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] Creating event network-changed:db85ea01-b6c6-4b18-9915-7bad0bf62a09 for instance c4fc2546-175f-4c4f-b755-b596d18abaf5 on hv-cinder-86243 Oct 23 20:20:33.481132 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-a9c964c5-bdbd-43ac-b56b-c39a8912b558 req-ba1900e0-7bc4-4737-9e47-b5f533591008 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037961 Oct 23 20:20:33.481730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 596/1230] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:20:34.242811 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:34.243420 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:34.249719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:34.250199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:34.250662 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:34.251971 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:34.252429 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:34.252847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:34.381802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:34.389419 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-72f5fc89-4e50-4e8a-ac82-06060c97bf85 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.150468 Oct 23 20:20:34.389992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 635/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:34 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:35.413044 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:35.413746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:35.420365 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:35.420849 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:35.421284 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:35.421975 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:35.422466 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:35.423471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:35.550545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:35.558070 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4c640491-38b9-4321-82e8-bd77b731cbca tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.149291 Oct 23 20:20:35.558666 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 597/1232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:35 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:36.580673 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:36.581273 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:36.587696 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:36.588168 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:36.588593 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:36.589271 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:36.589716 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:36.590130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:36.718732 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:36.726447 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-95a85bc3-b575-4547-ad44-48c5a53f54b1 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.149670 Oct 23 20:20:36.727106 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 636/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:36 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:37.748921 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:37.749563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:37.756547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:37.757019 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:37.757491 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:37.758165 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:37.758637 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:37.759051 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:37.887861 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:37.895908 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-873ba00d-6771-4231-bd86-c07ace924b73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.150899 Oct 23 20:20:37.896474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 598/1234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:37 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:38.918534 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:38.919163 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:38.925497 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:38.925977 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:38.926453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:38.927135 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:38.927587 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:38.928007 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:39.059352 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:39.067482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1c6b1feb-96f6-4d16-97cd-ed3ecd13a46c tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.152900 Oct 23 20:20:39.068043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 637/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:38 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:40.090718 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:40.091335 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:40.093724 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:40.094408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:40.100747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.101230 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.101665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.102380 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.102839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.103261 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.232474 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:40.240321 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e4ccb15b-56a6-4b15-96d3-feef5101d9ae tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.153483 Oct 23 20:20:40.240892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 599/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:40 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:40.527445 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:40.527929 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:40.534196 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.534704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.535136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.535818 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.536270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.536694 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.615601 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.objects.instance [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lazy-loading 'services' on Instance uuid 6b69aacd-d9e1-4e56-ac6a-810be561e773 {{(pid=118867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 20:20:40.685941 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-25813a5a-8aa0-45bd-b462-68a785bf801d tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments/56cf1469-fdca-4126-a2d5-eb52a3591f18" status: 202 len: 0 microversion: 2.1 time: 0.162325 Oct 23 20:20:40.686558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 638/1237] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 23 20:20:40 2022] DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments/56cf1469-fdca-4126-a2d5-eb52a3591f18 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:20:40.696128 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:40.698401 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:40.705338 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.705899 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.706595 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.707361 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:40.707822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:40.708244 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:40.738663 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-76d24fdc-7058-45a8-9638-657b985048dc tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047175 Oct 23 20:20:40.739234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 600/1238] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:20:40 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:41.260499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:41.264612 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:41.265299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:41.273324 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.274200 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.274763 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.275454 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.275906 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.276326 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.411098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:41.418935 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-bd03cbda-ac60-47c9-8046-e719ebe314c8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.159324 Oct 23 20:20:41.419499 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 639/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:41 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:41.750830 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:41.753025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:41.759408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.759885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.760316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.761002 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.761453 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.761876 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.790944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4c37e571-362d-4f95-a76e-b494fb977ec2 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044167 Oct 23 20:20:41.791501 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 601/1240] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 23 20:20:41 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 20:20:41.855713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:41.856190 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:41.862538 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.863015 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.863443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.864127 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.864576 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.864997 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.889802 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Going to try to terminate instance {{(pid=118867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:20:41.962108 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-b578c494-d501-4056-844e-ca5537bc0ae9 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 204 len: 0 microversion: 2.1 time: 0.110025 Oct 23 20:20:41.962856 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 640/1241] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:41 2022] DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:20:41.971627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:41.972241 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:41.978101 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.978611 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.979046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:41.979730 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:41.980183 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:41.980608 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:42.104892 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:42.112571 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-8efca041-9bcb-435e-9fb0-8f74b3b191af tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1681 microversion: 2.1 time: 0.145380 Oct 23 20:20:42.113140 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 602/1242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:41 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:42.443392 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:42.444091 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:42.449998 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:42.450791 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:42.451223 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:42.451904 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:42.452356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:42.452776 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:42.583133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:42.591521 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-03ada2ec-cb74-4e5a-9d00-76641f94691d tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.152994 Oct 23 20:20:42.592088 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 641/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:42 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:43.136263 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:43.136823 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:43.143840 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:43.144330 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:43.144819 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:43.145503 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:43.145906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:43.146352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:43.279109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:43.287083 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4a8db118-4b28-4ffb-aaba-a537192557f3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1681 microversion: 2.1 time: 0.154892 Oct 23 20:20:43.287662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 603/1244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:43 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:43.615016 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:43.615654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:43.621990 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:43.622520 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:43.622958 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:43.623648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:43.624112 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:43.624537 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:43.754567 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:43.762146 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-8cccf955-f07f-47ab-bfa2-f31c271b8c52 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.151720 Oct 23 20:20:43.762745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 642/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:43 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:44.310558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:44.311173 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:44.318005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:44.318526 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:44.318962 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:44.319662 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:44.320118 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:44.320547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:44.454222 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbbf111f714b108435b58c5b6c2747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f456c92d544d0c81bcb2fe937188ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:44.463199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4278ee72-b694-481c-b576-e1be1b6001f0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 200 len: 1681 microversion: 2.1 time: 0.156614 Oct 23 20:20:44.463783 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 604/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:44 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:44.680934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b69aacd-d9e1-4e56-ac6a-810be561e773", "name": "network-vif-deleted", "tag": "35c91706-bf06-4191-8366-078e0ab89e0e"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:44.694498 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:44.695284 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:44.695714 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:44.709915 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] Creating event network-vif-deleted:35c91706-bf06-4191-8366-078e0ab89e0e for instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 on hv-cinder-86243 Oct 23 20:20:44.716414 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-8f6a86fa-41f6-4dd2-8315-06c1c5b58f05 req-22fea0db-b4a2-4e32-bce2-b65962a9c2a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039584 Oct 23 20:20:44.717706 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 643/1247] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:44.785460 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:44.786153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:44.792253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:44.792866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:44.793390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:44.794641 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:44.795004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:44.795558 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:44.941744 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:44.946423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:44.951731 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-491c6151-973f-42b5-9717-5c72f5313a0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.170932 Oct 23 20:20:44.952313 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 605/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:44 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:45.457625 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fc2546-175f-4c4f-b755-b596d18abaf5", "name": "network-vif-plugged", "status": "completed", "tag": "db85ea01-b6c6-4b18-9915-7bad0bf62a09"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:45.469749 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:45.470371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:45.470886 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:45.488763 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:45.489332 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] Creating event network-vif-plugged:db85ea01-b6c6-4b18-9915-7bad0bf62a09 for instance c4fc2546-175f-4c4f-b755-b596d18abaf5 on hv-cinder-86243 Oct 23 20:20:45.489545 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:45.497652 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:45.497863 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-4698d6ab-2161-4956-8307-4d40b81fa645 req-a7c0272a-ca57-4ad9-bfa2-e592fdbbe6b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044487 Oct 23 20:20:45.498956 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:45.499192 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 644/1249] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:45.499781 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:45.500535 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:45.501773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:45.502390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:45.521452 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 HTTP/1.1 Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:45.523563 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:45.525268 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '6b69aacd-d9e1-4e56-ac6a-810be561e773'} Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:45.526155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:45.527879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:45.529653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:45.529653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-40f61d24-b089-4230-9b52-e9768593cf2c tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 404 len: 111 microversion: 2.1 time: 0.041977 Oct 23 20:20:45.529653 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 606/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:45 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:45.537775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-19cae6af-497a-4d24-9722-770664175ce3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '.version_select at 0x7f64f01c4a60>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:45.559210 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-19cae6af-497a-4d24-9722-770664175ce3 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435062568" status: 202 len: 0 microversion: 2.1 time: 0.026756 Oct 23 20:20:45.559878 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 645/1251] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 23 20:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435062568 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 20:20:45.975120 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:45.975859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:45.981749 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:45.982340 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:45.982846 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:45.983609 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:45.984172 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:45.984686 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:46.161292 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:46.169278 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d5832b76-271d-49ea-9194-3f3aae05c9bc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.198035 Oct 23 20:20:46.169848 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 607/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:45 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:20:47.192624 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:47.193480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:47.200218 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.200951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.201381 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.202064 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.202614 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.203000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.339474 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:47.348389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-253f9333-6b4a-40cc-a6b1-3363590ba6a7 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1263 microversion: 2.1 time: 0.160364 Oct 23 20:20:47.348979 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 646/1253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:47 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:47.408777 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:47.409281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:47.415646 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.416127 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.416580 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.417251 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.417708 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.418133 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.431192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 HTTP/1.1 Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:47.432746 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.434390 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '6b69aacd-d9e1-4e56-ac6a-810be561e773'} Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:47.435331 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.436855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.439757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:47.439757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-2f5ea401-1f03-4c47-99ba-495a2c7db887 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 404 len: 111 microversion: 2.1 time: 0.029233 Oct 23 20:20:47.439757 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 608/1254] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:47 2022] DELETE /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:47.446708 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:47.447322 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 6b69aacd-d9e1-4e56-ac6a-810be561e773] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:47.453450 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.454610 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.455046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.455731 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:47.456188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:47.456617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:47.460617 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:20:47.470951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 HTTP/1.1 Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:20:47.472999 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.474701 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '6b69aacd-d9e1-4e56-ac6a-810be561e773'} Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:47.475649 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. Oct 23 20:20:47.477160 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:47.478495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 6b69aacd-d9e1-4e56-ac6a-810be561e773 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:47.478495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0cbbe6b8-a067-4dfd-beb1-853e96f3e660 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773" status: 404 len: 111 microversion: 2.1 time: 0.031505 Oct 23 20:20:47.478495 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 647/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:47 2022] GET /compute/v2.1/servers/6b69aacd-d9e1-4e56-ac6a-810be561e773 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:48.370471 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.371072 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.376935 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.377407 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.377832 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.378534 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.378982 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.379396 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.508329 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:48.515992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0f9a7adb-34f4-4480-b779-1b3726caffc8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1450 microversion: 2.1 time: 0.149391 Oct 23 20:20:48.517054 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 609/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:48 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:48.539201 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.539803 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.546974 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.547478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.547902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.548573 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.549017 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.549432 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.614696 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.615200 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.621221 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.621642 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.622076 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.622797 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.623257 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.623680 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.636946 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a HTTP/1.1 Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:48.638548 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.640143 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '3c571552-4e80-4170-9cc6-aa8ccb5a180a'} Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:48.644539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.646155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.647736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:48.647736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-569ffb43-a5b2-4c9e-8df9-505b2cfa8ebe tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 404 len: 111 microversion: 2.1 time: 0.029138 Oct 23 20:20:48.647736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 610/1257] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:48 2022] DELETE /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 20:20:48.649844 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.650473 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: 3c571552-4e80-4170-9cc6-aa8ccb5a180a] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.656318 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.657397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.657829 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.658547 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.658992 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.659405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.672687 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a HTTP/1.1 Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:48.674192 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.675854 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '3c571552-4e80-4170-9cc6-aa8ccb5a180a'} Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:48.676760 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. Oct 23 20:20:48.678489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.682654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance 3c571552-4e80-4170-9cc6-aa8ccb5a180a could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:48.682654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-cff3f801-ced4-4d1a-bbea-868d4751da9e tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a" status: 404 len: 111 microversion: 2.1 time: 0.030043 Oct 23 20:20:48.682654 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 611/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:48 2022] GET /compute/v2.1/servers/3c571552-4e80-4170-9cc6-aa8ccb5a180a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 20:20:48.682920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:20:48.686581 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.686720 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-07b10f6c-32b0-41c9-936e-8b8b9282e2dd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1450 microversion: 2.1 time: 0.151644 Oct 23 20:20:48.687077 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.687488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 648/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:48 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:48.692900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.693389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.693817 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.694529 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.694979 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.695397 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.711135 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 HTTP/1.1 Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:48.712674 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.714339 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'aed421b0-ddb9-4cbf-bee9-d88167e9fdf3'} Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:48.715177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.716678 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.718188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:48.718188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-4449c31b-feb1-4433-82e0-08379c47ce43 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 404 len: 111 microversion: 2.1 time: 0.031696 Oct 23 20:20:48.718188 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 612/1260] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:48 2022] DELETE /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:48.723354 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:48.724006 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: aed421b0-ddb9-4cbf-bee9-d88167e9fdf3] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:48.729832 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.730337 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.730764 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.731440 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:48.731889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:48.732303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:48.745530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 HTTP/1.1 Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:20:48.747323 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.748775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'aed421b0-ddb9-4cbf-bee9-d88167e9fdf3'} Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:48.749814 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. Oct 23 20:20:48.751926 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:48.753544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:48.753544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-9d857d62-ff47-4be1-9372-38eebc3cb8aa tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3" status: 404 len: 111 microversion: 2.1 time: 0.029981 Oct 23 20:20:48.753544 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 649/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:48 2022] GET /compute/v2.1/servers/aed421b0-ddb9-4cbf-bee9-d88167e9fdf3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:49.898225 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:49.898781 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:49.905144 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:49.905624 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:49.906053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:49.907436 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:49.907893 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:49.908315 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:49.921865 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 HTTP/1.1 Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:20:49.923438 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.925122 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'cbdda865-b8ca-4233-b550-d4c6a3127e61'} Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:49.925973 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.927533 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.929630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:49.929630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b2b7b49f-4ccc-482d-a1d7-6b01bbc60af0 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 404 len: 111 microversion: 2.1 time: 0.031516 Oct 23 20:20:49.929630 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 613/1262] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:20:49 2022] DELETE /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:49.933219 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:49.933824 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] [instance: cbdda865-b8ca-4233-b550-d4c6a3127e61] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:20:49.940149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:49.940622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:49.941049 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:49.941728 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:49.942173 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:49.942622 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:49.956542 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] HTTP exception thrown: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Request method failure captured: Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 HTTP/1.1 Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaBD2dYXnmfTNLhiKKhosfon9Yq5YUZRr_dYnsfjpK86lkP6ElTcalqaCjkBao500Ve5-8n3H4veTKQXzjokbpXADnTvRe29jQsAtkyENTFZurI1DjUnNeS7uBA3I-O1OMqWQzh28blXKcYHIm5O6ErBKts8c8RmjRzkaD6BEiAH5AA Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:20:49.958119 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71f456c92d544d0c81bcb2fe937188ef", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71f456c92d544d0c81bcb2fe937188ef"}]}] Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: 71f456c92d544d0c81bcb2fe937188ef Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901812016 Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 10bbbf111f714b108435b58c5b6c2747 Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-AttachVolumeNegativeTest-1901812016-project Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.960133 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': 'cbdda865-b8ca-4233-b550-d4c6a3127e61'} Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:20:49.961098 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. Oct 23 20:20:49.963080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:20:49.966970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] Returning 404 to user: Instance cbdda865-b8ca-4233-b550-d4c6a3127e61 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:20:49.966970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-101938b4-ad86-478f-ac00-ded5f84e3f59 tempest-AttachVolumeNegativeTest-1901812016 tempest-AttachVolumeNegativeTest-1901812016-project] 10.222.0.13 "GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61" status: 404 len: 111 microversion: 2.1 time: 0.030315 Oct 23 20:20:49.966970 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 650/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:20:49 2022] GET /compute/v2.1/servers/cbdda865-b8ca-4233-b550-d4c6a3127e61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:20:50.511879 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc2546-175f-4c4f-b755-b596d18abaf5", "tag": "db85ea01-b6c6-4b18-9915-7bad0bf62a09"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:20:50.522103 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:20:50.522605 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:20:50.523155 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:20:50.536253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] Creating event network-changed:db85ea01-b6c6-4b18-9915-7bad0bf62a09 for instance c4fc2546-175f-4c4f-b755-b596d18abaf5 on hv-cinder-86243 Oct 23 20:20:50.541476 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-8ba79e6f-991b-497e-be3d-241127fe1f8d req-1e10d977-53f5-401c-b529-ecfc3cd86dd3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033271 Oct 23 20:20:50.542499 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 614/1264] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:55.718226 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-57c642a5-f413-4fa6-883e-6c0ae7f7005a tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f034cc10>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:55.764781 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-57c642a5-f413-4fa6-883e-6c0ae7f7005a tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f7083e5d-c3b9-4162-9980-677376fabaa4" status: 200 len: 351 microversion: 2.1 time: 0.050271 Oct 23 20:20:55.765336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 651/1265] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:20:55 2022] GET /compute/v2.1/os-volumes/f7083e5d-c3b9-4162-9980-677376fabaa4 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:57.100011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0853c6a4-8fe1-4f1e-a75b-9726909ccf23 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f3c54af0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:57.145528 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0853c6a4-8fe1-4f1e-a75b-9726909ccf23 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4daada68-12e7-4dd4-bdaf-7ef40e60d039" status: 200 len: 350 microversion: 2.1 time: 0.050216 Oct 23 20:20:57.146111 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 615/1266] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:20:57 2022] GET /compute/v2.1/os-volumes/4daada68-12e7-4dd4-bdaf-7ef40e60d039 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:58.478080 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-27aa6095-ef66-4818-b5ae-8ed9d26b5ca6 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f0388a60>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:58.525152 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-27aa6095-ef66-4818-b5ae-8ed9d26b5ca6 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b6b113ca-f188-4803-b1ef-d45682262dc8" status: 200 len: 350 microversion: 2.1 time: 0.051012 Oct 23 20:20:58.526238 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 652/1267] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes/b6b113ca-f188-4803-b1ef-d45682262dc8 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:58.539747 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-77c26f7c-3da4-4001-a853-e9cb839a656d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f0330c10>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:58.622444 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-77c26f7c-3da4-4001-a853-e9cb839a656d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086925 Oct 23 20:20:58.623020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 616/1268] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:58.637805 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-444e3582-b5c8-402e-b657-c81d9a29f47d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f03a5af0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:58.720967 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-444e3582-b5c8-402e-b657-c81d9a29f47d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087205 Oct 23 20:20:58.721530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 653/1269] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:58.735352 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-6847965a-f544-434f-9a84-fc8892ac9fa2 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f05d1af0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:58.816472 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-6847965a-f544-434f-9a84-fc8892ac9fa2 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084917 Oct 23 20:20:58.817039 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 617/1270] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:20:58.830952 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1f02f60e-85e8-4b1d-bec1-a11575f66ad7 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f01ddaf0>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:58.913604 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1f02f60e-85e8-4b1d-bec1-a11575f66ad7 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087104 Oct 23 20:20:58.914173 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 654/1271] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:58.927900 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-bca821e1-71b6-4a69-9589-0f8d63599cef tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f10fc160>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:59.007564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-bca821e1-71b6-4a69-9589-0f8d63599cef tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083348 Oct 23 20:20:59.008130 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 618/1272] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 23 20:20:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:59.022303 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-12416506-616b-46bb-b332-791566f1e3f3 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f04f6f70>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:59.103042 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-12416506-616b-46bb-b332-791566f1e3f3 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084723 Oct 23 20:20:59.103613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 655/1273] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 23 20:20:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:20:59.117253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-c584010e-7a89-4987-be69-610a0e8215a9 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f03303a0>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:59.196894 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-c584010e-7a89-4987-be69-610a0e8215a9 tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083327 Oct 23 20:20:59.197479 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 619/1274] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 23 20:20:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:20:59.210769 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-74a18416-e1bf-4f09-bbc6-599679ef956d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] Calling method '.version_select at 0x7f64f034cc10>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:20:59.292252 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-74a18416-e1bf-4f09-bbc6-599679ef956d tempest-VolumesTestJSON-313566231 tempest-VolumesTestJSON-313566231-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085186 Oct 23 20:20:59.292823 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 656/1275] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 23 20:20:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:50.680650 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a39729bb-95f1-46ed-afc4-c52350e2eba8] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:22:50.681142 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:22:50.681941 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=26 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:22:50.682612 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 20:22:50.682776 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Sun Oct 23 20:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 23 20:22:50.685047 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 23 20:22:50.690640 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787523657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1674619008", "security_groups": [{"name": "tempest-secgroup-smoke-7927693"}], "block_device_mapping_v2": [{"uuid": "3c8309b9-0036-471d-888c-b614d9df82a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfd87eb0-6e12-4670-accf-38eb6ce06b92"}]}} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:22:50.806409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.network.neutron [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] validate_networks() for [('dfd87eb0-6e12-4670-accf-38eb6ce06b92', None, None, None, None, None)] {{(pid=118866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 20:22:51.256511 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 20:22:51.256934 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image limits 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 20:22:51.257408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Flavor pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 20:22:51.257821 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Image pref 0:0:0 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 20:22:51.258234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.virt.hardware [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 20:22:51.267056 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:51.267539 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:51.267971 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:51.268698 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:51.269153 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:51.269584 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:51.285913 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 20:22:51.290005 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.quota [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Getting quotas for user 2e15e1e499874c01b8d9b4aec9f9eb9c and project deacebf04e2d4a8093425ce7d16ca3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=118866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 20:22:51.345695 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Going to run 1 instances... {{(pid=118866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 20:22:51.347951 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c8309b9-0036-471d-888c-b614d9df82a5',volume_size=None,volume_type=None)] {{(pid=118866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 20:22:51.477082 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-80dfaecb-82e2-4f9c-b2d2-ccf202ed5027 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.797980 Oct 23 20:22:51.477736 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 620/1276] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 23 20:22:50 2022] POST /compute/v2.1/servers => generated 403 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 20:22:51.486905 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde30013-8922-458c-914b-e9147acc244b] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:22:51.487438 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:22:51.488459 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=10 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:22:51.490345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 20:22:51.490600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Sun Oct 23 20:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 (ip 10.222.0.13) !!! Oct 23 20:22:51.498062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-1b5c3d44-4ed8-4eb9-a220-a3b672298bbe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:51.498710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-1b5c3d44-4ed8-4eb9-a220-a3b672298bbe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:51.554687 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-1b5c3d44-4ed8-4eb9-a220-a3b672298bbe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:51.561496 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-1b5c3d44-4ed8-4eb9-a220-a3b672298bbe tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1095 microversion: 2.1 time: 0.076274 Oct 23 20:22:51.562002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 657/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:51 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:52.586170 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:52.587496 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:52.596362 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:52.596851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:52.597287 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:52.597994 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:52.599011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:52.599514 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:52.606174 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [-] [a39729bb-95f1-46ed-afc4-c52350e2eba8] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52054. Oct 23 20:22:52.666723 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:52.676886 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-80ec7ffe-4b9d-4ab3-bcc5-d64562e93e8a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1211 microversion: 2.1 time: 0.095864 Oct 23 20:22:52.677720 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 621/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:52 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:53.700245 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:53.701232 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:53.712563 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde30013-8922-458c-914b-e9147acc244b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52058. Oct 23 20:22:53.718410 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:53.719478 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:53.720159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:53.720928 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:53.721598 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:53.722480 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:53.859502 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:53.867877 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-20d884cf-1a28-4ba1-b75f-dd1488602db6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.171558 Oct 23 20:22:53.868446 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 658/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:53 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:54.296711 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d508bd5-6b23-4498-9179-a7f1132bae15", "tag": "660b66e9-b49c-42ae-80ad-0c6345954e63"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:22:54.306158 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:54.306751 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:54.307253 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:54.318046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] Creating event network-changed:660b66e9-b49c-42ae-80ad-0c6345954e63 for instance 9d508bd5-6b23-4498-9179-a7f1132bae15 on hv-cinder-86243 Oct 23 20:22:54.321445 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR oslo.messaging._drivers.impl_rabbit [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] [6104c713-83ba-4d15-94f6-00b9c389e782] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 20:22:54.890307 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:54.890922 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:54.898081 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:54.898637 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:54.899075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:54.899768 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:54.900256 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:54.900679 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:55.027782 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:55.035389 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-12ee885e-c41f-4b72-9d82-d9e58bbe0e73 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.148961 Oct 23 20:22:55.035961 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 659/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:54 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:22:55.328306 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO oslo.messaging._drivers.impl_rabbit [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] [6104c713-83ba-4d15-94f6-00b9c389e782] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52066. Oct 23 20:22:55.331685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-fad274ed-a569-4df8-a3cd-8eb08038bd0a req-19965e97-a160-42ec-a1be-66a46ac96b5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.177127 Oct 23 20:22:55.332333 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 622/1281] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 20:22:56.057847 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:56.058488 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:56.064788 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:56.065265 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:56.065693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:56.066406 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:56.067404 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:56.067825 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:56.197740 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:56.205628 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-79dfd66b-cfe6-49dc-af7c-83d4a984fb01 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.151616 Oct 23 20:22:56.206193 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 660/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:56 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:57.230059 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:57.230812 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:57.236902 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:57.237383 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:57.237811 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:57.239004 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:57.239468 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:57.239885 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:57.369029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:57.376675 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3372ddc9-ee2f-4d6b-805f-8aefe7eca7b5 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.151395 Oct 23 20:22:57.377242 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 623/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:57 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:22:58.400613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:58.401214 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:58.407561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:58.408047 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:58.408461 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:58.409130 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:58.409582 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:58.409992 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:58.537772 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:58.545453 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-fb28c561-73f5-46af-9041-f2bd732ba0fc tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.148771 Oct 23 20:22:58.546018 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 661/1284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:58 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:22:59.568940 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:22:59.569559 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:22:59.576221 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:59.576702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:59.577136 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:59.577822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:22:59.578298 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:22:59.578725 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:22:59.710948 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:22:59.718607 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-3108fe93-73a7-45b7-8ae7-679d35a41d92 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.154287 Oct 23 20:22:59.719177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 624/1285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:22:59 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:00.741345 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:00.741948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:00.748357 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:00.748838 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:00.749266 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:00.749953 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:00.750435 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:00.750857 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:00.878765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:00.886981 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-a591a2f5-da86-4723-96a8-818256ba96da tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.149592 Oct 23 20:23:00.887546 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 662/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:00 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:01.910166 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:01.911859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:01.914690 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=2 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:23:01.915423 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell0:SELECT=6 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:23:01.921029 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:01.921510 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:01.921943 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:01.922658 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:01.923113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:01.923541 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:02.053692 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:02.061389 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-f9eeb9f6-876d-4f9d-b623-df257366514b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.155116 Oct 23 20:23:02.061957 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 625/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:01 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:03.085558 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:03.086198 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:03.088090 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell0:SELECT=2 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:23:03.094000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:03.094517 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:03.094939 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:03.095618 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:03.096066 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:03.096482 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:03.224370 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:03.231983 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-6c8c6239-63b5-4be0-b5e6-f6720ffcab0b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.150974 Oct 23 20:23:03.232550 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 663/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:03 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:23:04.255489 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:04.256138 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:04.262560 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:04.263046 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:04.263490 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:04.264177 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:04.264639 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:04.265065 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:04.397283 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:04.405097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-176a4374-8551-42f0-a93a-f9e1a34d4377 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.154058 Oct 23 20:23:04.418271 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 626/1289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:04 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:05.428844 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:05.429477 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:05.436046 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:05.436518 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:05.436943 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:05.437882 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:05.438360 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:05.438775 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:05.565371 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:05.573486 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-49a645f2-16dc-400b-be7a-182d1ecaadee tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.148960 Oct 23 20:23:05.574043 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 664/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:05 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:06.017710 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d508bd5-6b23-4498-9179-a7f1132bae15", "name": "network-vif-plugged", "status": "completed", "tag": "660b66e9-b49c-42ae-80ad-0c6345954e63"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:23:06.028160 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:06.028693 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:06.029113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:06.039597 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] Creating event network-vif-plugged:660b66e9-b49c-42ae-80ad-0c6345954e63 for instance 9d508bd5-6b23-4498-9179-a7f1132bae15 on hv-cinder-86243 Oct 23 20:23:06.044765 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-1ccd9a88-d33c-493c-9b93-a9cdd6f881f6 req-c5497e5d-0a4e-4a55-84dd-25f279021681 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088619 Oct 23 20:23:06.045343 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 627/1291] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:23:06.596443 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:06.597056 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:06.603924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:06.604403 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:06.604831 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:06.605516 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:06.605968 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:06.606415 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:06.731934 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:06.740076 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-43048954-5912-4fc3-844d-3b1782d92c86 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.147503 Oct 23 20:23:06.740636 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 665/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:06 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:07.763109 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:07.763731 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:07.770357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:07.770839 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:07.771377 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:07.772378 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:07.773178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:07.773785 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:07.912988 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:07.920944 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-0d170c7b-a6b5-418c-9f99-e048a0a88957 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1264 microversion: 2.1 time: 0.162259 Oct 23 20:23:07.921521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 628/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:07 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:08.943996 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:08.944607 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:08.951253 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:08.951733 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:08.952161 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:08.952841 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:08.953292 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:08.953711 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:09.083955 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:09.091586 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-30a3434c-e2c3-44bd-bd11-bc4bc494fbaf tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1452 microversion: 2.1 time: 0.151470 Oct 23 20:23:09.092149 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 666/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:08 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:09.113235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:23:09.113851 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:23:09.120256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:09.120743 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:09.121178 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:09.121866 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:09.122359 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:09.122787 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:09.251281 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:23:09.259564 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-796bcbcd-3754-4a8c-ba2e-623b4d3cb05b tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1452 microversion: 2.1 time: 0.150114 Oct 23 20:23:09.260131 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 629/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:23:09 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:23:10.879951 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d508bd5-6b23-4498-9179-a7f1132bae15", "tag": "660b66e9-b49c-42ae-80ad-0c6345954e63"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:23:10.889590 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:23:10.890062 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:23:10.890507 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:23:10.901858 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] Creating event network-changed:660b66e9-b49c-42ae-80ad-0c6345954e63 for instance 9d508bd5-6b23-4498-9179-a7f1132bae15 on hv-cinder-86243 Oct 23 20:23:10.907719 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-d7a3be67-ea98-401b-89ba-73542ade8bcb req-d3b5dbf8-e300-4fd8-a23f-b8520f7d66f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Oct 23 20:23:10.908530 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 667/1296] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:25:13.739312 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:25:13.740216 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG dbcounter [-] [118866] Writing DB stats nova_cell1:SELECT=48 {{(pid=118866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:25:13.744806 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde30013-8922-458c-914b-e9147acc244b] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 20:25:13.745996 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:13.746159 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_api:SELECT=24 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:25:13.746543 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:13.747070 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG dbcounter [-] [118867] Writing DB stats nova_cell1:SELECT=56 {{(pid=118867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:25:13.747861 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 20:25:13.748002 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Sun Oct 23 20:25:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 23 20:25:13.754855 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:13.755272 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d508bd5-6b23-4498-9179-a7f1132bae15", "tag": "660b66e9-b49c-42ae-80ad-0c6345954e63"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:25:13.755425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:13.756121 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:13.757327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:13.757327 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:13.757699 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:13.766946 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:13.767427 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:13.768299 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:13.780713 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] Creating event network-changed:660b66e9-b49c-42ae-80ad-0c6345954e63 for instance 9d508bd5-6b23-4498-9179-a7f1132bae15 on hv-cinder-86243 Oct 23 20:25:13.784199 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:25:13.787269 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-8a003972-e383-4ee5-abce-e8572ea2c30d req-8d21ce2c-bfe1-4d08-b3d8-4c2c0dfd19e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044183 Oct 23 20:25:13.787269 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 668/1297] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:25:13.874236 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5b4e830d-99de-40a0-8df3-751a2e939b26 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 204 len: 0 microversion: 2.1 time: 0.136637 Oct 23 20:25:13.875822 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 630/1298] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:25:13 2022] DELETE /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:25:13.885199 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:13.886208 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:13.892356 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:13.892836 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:13.893270 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:13.893962 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:13.894994 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:13.895422 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:14.030000 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:14.037688 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-005c5260-0702-4cd0-9569-df5c497aac0a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1577 microversion: 2.1 time: 0.156706 Oct 23 20:25:14.038283 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 669/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:13 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:25:15.060665 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:15.061357 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:15.068619 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:15.069097 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:15.069521 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:15.070202 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:15.070677 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:15.071093 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:15.208011 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:15.216234 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-5dcf981e-4a36-4974-a70c-5d5bb261ce80 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1577 microversion: 2.1 time: 0.159834 Oct 23 20:25:15.218685 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 631/1300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:15 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:25:16.093276 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d508bd5-6b23-4498-9179-a7f1132bae15", "name": "network-vif-deleted", "tag": "660b66e9-b49c-42ae-80ad-0c6345954e63"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:25:16.106413 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:16.106902 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:16.107336 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:16.120431 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] Creating event network-vif-deleted:660b66e9-b49c-42ae-80ad-0c6345954e63 for instance 9d508bd5-6b23-4498-9179-a7f1132bae15 on hv-cinder-86243 Oct 23 20:25:16.126063 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-9fb03d82-46fc-4bec-ab2a-ad361b311bf5 req-61738d96-ba9b-4477-bc7d-967a3fb1ea17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036486 Oct 23 20:25:16.126710 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 670/1301] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:25:16.239116 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:16.239753 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:16.246119 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:16.246627 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:16.247057 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:16.247741 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:16.248196 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:16.248616 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:16.308420 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:16.316835 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-e85f77f3-fbd9-48c5-a799-4bdb61a3f16a tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 200 len: 1226 microversion: 2.1 time: 0.081052 Oct 23 20:25:16.317408 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 632/1302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:16 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:25:17.339982 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:17.340677 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 9d508bd5-6b23-4498-9179-a7f1132bae15] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:17.342809 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde30013-8922-458c-914b-e9147acc244b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 52160. Oct 23 20:25:17.348174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:17.348648 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:17.349074 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:17.349742 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:17.350188 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:17.350654 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:17.364075 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] HTTP exception thrown: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Request method failure captured: Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 HTTP/1.1 Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaFCB7bZHwNSyhQNLAt0wNE2olVobrJaFy9W0Sx3L-ExbzX1fI4EgxVuQlkfYC9UBV4U9ZNCH8e_7lSKwyhWrG2GxwLBEZLgYLiflaL5BbdjccRukAoBU0ljGkuRzw_yJeTkiVRLXVpMwIOQEtvgiDKzgUu6FQfsykOvL5ZmbTK_idg Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:25:17.365658 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_deacebf04e2d4a8093425ce7d16ca3cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}] Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 2e15e1e499874c01b8d9b4aec9f9eb9c Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. Oct 23 20:25:17.367396 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '9d508bd5-6b23-4498-9179-a7f1132bae15'} Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:25:17.368600 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. Oct 23 20:25:17.370341 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:17.372060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Returning 404 to user: Instance 9d508bd5-6b23-4498-9179-a7f1132bae15 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:25:17.372060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-0a0a38c5-ed44-42ce-95f3-b54e7e559735 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15" status: 404 len: 111 microversion: 2.1 time: 0.031282 Oct 23 20:25:17.372060 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 671/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:17 2022] GET /compute/v2.1/servers/9d508bd5-6b23-4498-9179-a7f1132bae15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:25:20.407869 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:20.408409 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:20.417061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:20.417553 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:20.418036 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:20.418773 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:20.419256 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:20.419702 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:20.450238 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Going to try to terminate instance {{(pid=118866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 20:25:20.542831 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-b53dac9b-996a-4a26-95df-f59931b4e444 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 204 len: 0 microversion: 2.1 time: 0.138583 Oct 23 20:25:20.543758 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 633/1304] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:25:20 2022] DELETE /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 20:25:20.552995 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:20.553707 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:20.559540 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:20.560021 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:20.560449 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:20.561148 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:20.561602 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:20.562020 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:20.563920 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc2546-175f-4c4f-b755-b596d18abaf5", "tag": "db85ea01-b6c6-4b18-9915-7bad0bf62a09"}]} {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:25:20.574948 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:20.575704 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:20.576369 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:20.588842 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.compute.server_external_events [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] Creating event network-changed:db85ea01-b6c6-4b18-9915-7bad0bf62a09 for instance c4fc2546-175f-4c4f-b755-b596d18abaf5 on hv-cinder-86243 Oct 23 20:25:20.593756 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [req-77a89a52-a621-4806-b5b2-049841de9c9e req-4199a576-e8a2-425d-be31-7df0a2740744 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187285 Oct 23 20:25:20.594561 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 672/1305] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:25:20.695599 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.policy [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:20.703412 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-64e7d460-62f4-4267-8f99-c113bfdd0b82 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1574 microversion: 2.1 time: 0.155266 Oct 23 20:25:20.703987 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 634/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:20 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 20:25:21.728039 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:21.728746 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:21.734960 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:21.735441 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:21.735879 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:21.736577 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:21.737052 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:21.737476 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:21.872790 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:21.881290 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-43530c2d-fb2c-4bbd-b7fb-8c9115194bc6 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1574 microversion: 2.1 time: 0.157990 Oct 23 20:25:21.881853 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 673/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:21 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:25:22.840148 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fc2546-175f-4c4f-b755-b596d18abaf5", "name": "network-vif-deleted", "tag": "db85ea01-b6c6-4b18-9915-7bad0bf62a09"}]} {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 20:25:22.850316 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:22.850802 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:22.851235 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:22.862513 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.compute.server_external_events [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] Creating event network-vif-deleted:db85ea01-b6c6-4b18-9915-7bad0bf62a09 for instance c4fc2546-175f-4c4f-b755-b596d18abaf5 on hv-cinder-86243 Oct 23 20:25:22.867485 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [req-e36453cf-1c19-44d3-89d8-cd55ed8f3eba req-2519cdb6-606b-4dd0-b8ec-1e6061d6bdae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031116 Oct 23 20:25:22.868027 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 635/1308] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 23 20:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 20:25:22.904613 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:22.905258 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:22.912351 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:22.912881 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:22.913321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:22.914217 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:22.914744 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:22.915136 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:22.978889 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.policy [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e15e1e499874c01b8d9b4aec9f9eb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deacebf04e2d4a8093425ce7d16ca3cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 20:25:22.986693 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-49097db8-ad6d-4961-ab55-c4e9a0b62e0f tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 200 len: 1225 microversion: 2.1 time: 0.085947 Oct 23 20:25:22.987257 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 674/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:22 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 20:25:24.009969 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:24.010715 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: c4fc2546-175f-4c4f-b755-b596d18abaf5] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:24.017025 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.017506 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.017931 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.018645 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.019096 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.019532 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.033149 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] HTTP exception thrown: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Request method failure captured: Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 HTTP/1.1 Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaFCB7bZHwNSyhQNLAt0wNE2olVobrJaFy9W0Sx3L-ExbzX1fI4EgxVuQlkfYC9UBV4U9ZNCH8e_7lSKwyhWrG2GxwLBEZLgYLiflaL5BbdjccRukAoBU0ljGkuRzw_yJeTkiVRLXVpMwIOQEtvgiDKzgUu6FQfsykOvL5ZmbTK_idg Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:25:24.035307 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_deacebf04e2d4a8093425ce7d16ca3cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}] Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 2e15e1e499874c01b8d9b4aec9f9eb9c Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. Oct 23 20:25:24.037053 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': 'c4fc2546-175f-4c4f-b755-b596d18abaf5'} Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:25:24.037906 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. Oct 23 20:25:24.039311 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.040575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Returning 404 to user: Instance c4fc2546-175f-4c4f-b755-b596d18abaf5 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:25:24.040575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d43584f5-7763-4446-b6c2-5c989f0b41fd tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5" status: 404 len: 111 microversion: 2.1 time: 0.031527 Oct 23 20:25:24.040575 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 636/1310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:24 2022] GET /compute/v2.1/servers/c4fc2546-175f-4c4f-b755-b596d18abaf5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:25:24.469664 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:24.470187 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.compute.api [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:24.477267 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.477745 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.478172 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.478875 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.479321 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.479739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG oslo_concurrency.lockutils [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.494765 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.wsgi [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] HTTP exception thrown: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Request method failure captured: Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: request: DELETE /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 HTTP/1.1 Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept: application/json Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Accept-Encoding: identity Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Connection: close Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Length: 0 Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Content-Type: application/json Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Host: 10.222.0.13 Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: Openstack-System-Scope: None Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: User-Agent: python-urllib3/1.26.12 Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Auth-Token: gAAAAABjVaFCB7bZHwNSyhQNLAt0wNE2olVobrJaFy9W0Sx3L-ExbzX1fI4EgxVuQlkfYC9UBV4U9ZNCH8e_7lSKwyhWrG2GxwLBEZLgYLiflaL5BbdjccRukAoBU0ljGkuRzw_yJeTkiVRLXVpMwIOQEtvgiDKzgUu6FQfsykOvL5ZmbTK_idg Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Id: None Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Domain-Name: None Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Identity-Status: Confirmed Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Is-Admin-Project: True Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Id: default Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Domain-Name: Default Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Project-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Role: member,reader Oct 23 20:25:24.496390 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Roles: member,reader Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_deacebf04e2d4a8093425ce7d16ca3cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}] Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-Tenant-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Id: default Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Domain-Name: Default Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Id: 2e15e1e499874c01b8d9b4aec9f9eb9c Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: X-User-Name: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: method: > Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: exception: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.498164 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: action_args: {'id': '831a4d3c-4e7f-4c11-b83a-92ba72480b30'} Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:25:24.499174 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.500553 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.501924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Returning 404 to user: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. {{(pid=118867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:25:24.501924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-51b5baf2-27a0-448d-af40-a717bdaa3182 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "DELETE /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 404 len: 111 microversion: 2.1 time: 0.032095 Oct 23 20:25:24.501924 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 675/1311] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 23 20:25:24 2022] DELETE /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:25:24.507184 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '>' {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:24.507799 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.compute.api [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] [instance: 831a4d3c-4e7f-4c11-b83a-92ba72480b30] Fetching instance by UUID {{(pid=118866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 20:25:24.513782 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.514275 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.514727 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.515405 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Acquiring lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 20:25:24.515859 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 20:25:24.516277 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG oslo_concurrency.lockutils [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Lock "2ff9404b-133d-4e93-bd33-12d6dd4a8031" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 20:25:24.530113 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.wsgi [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] HTTP exception thrown: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Request method failure captured: Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: request: GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 HTTP/1.1 Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept: application/json Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Accept-Encoding: identity Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Connection: close Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Length: 0 Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Content-Type: application/json Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Host: 10.222.0.13 Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: Openstack-System-Scope: None Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: User-Agent: python-urllib3/1.26.12 Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Auth-Token: gAAAAABjVaFCB7bZHwNSyhQNLAt0wNE2olVobrJaFy9W0Sx3L-ExbzX1fI4EgxVuQlkfYC9UBV4U9ZNCH8e_7lSKwyhWrG2GxwLBEZLgYLiflaL5BbdjccRukAoBU0ljGkuRzw_yJeTkiVRLXVpMwIOQEtvgiDKzgUu6FQfsykOvL5ZmbTK_idg Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Id: None Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Domain-Name: None Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Identity-Status: Confirmed Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Is-Admin-Project: True Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Id: default Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Domain-Name: Default Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Project-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Role: member,reader Oct 23 20:25:24.531661 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Roles: member,reader Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_deacebf04e2d4a8093425ce7d16ca3cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/deacebf04e2d4a8093425ce7d16ca3cf"}]}] Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Id: deacebf04e2d4a8093425ce7d16ca3cf Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-Tenant-Name: tempest-TestVolumeBootPattern-1407875742 Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Id: default Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Domain-Name: Default Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Id: 2e15e1e499874c01b8d9b4aec9f9eb9c Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: X-User-Name: tempest-TestVolumeBootPattern-1407875742-project Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: method: > Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: exception: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.533402 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: action_args: {'id': '831a4d3c-4e7f-4c11-b83a-92ba72480b30'} Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: {{(pid=118866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 20:25:24.534425 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. Oct 23 20:25:24.536061 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: ERROR nova.api.openstack.wsgi Oct 23 20:25:24.537726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: DEBUG nova.api.openstack.wsgi [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Returning 404 to user: Instance 831a4d3c-4e7f-4c11-b83a-92ba72480b30 could not be found. {{(pid=118866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 20:25:24.537726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: INFO nova.api.openstack.requestlog [None req-d8a35536-79bc-4c4b-b16f-1abf0ff19ff8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30" status: 404 len: 111 microversion: 2.1 time: 0.030247 Oct 23 20:25:24.537726 dv-cinder-862432-1-iscsi devstack@n-api.service[118866]: [pid: 118866|app: 0|req: 637/1312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 23 20:25:24 2022] GET /compute/v2.1/servers/831a4d3c-4e7f-4c11-b83a-92ba72480b30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 20:25:25.822376 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: DEBUG nova.api.openstack.wsgi [None req-e407ae1a-d028-41b1-b642-714a2ce145f8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] Calling method '.version_select at 0x7f64f0189790>' {{(pid=118867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 20:25:25.845304 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: INFO nova.api.openstack.requestlog [None req-e407ae1a-d028-41b1-b642-714a2ce145f8 tempest-TestVolumeBootPattern-1407875742 tempest-TestVolumeBootPattern-1407875742-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1674619008" status: 202 len: 0 microversion: 2.1 time: 0.026638 Oct 23 20:25:25.845739 dv-cinder-862432-1-iscsi devstack@n-api.service[118867]: [pid: 118867|app: 0|req: 676/1313] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 23 20:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1674619008 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)